-- Logs begin at Wed 2022-07-20 14:04:18 UTC, end at Wed 2022-07-20 15:18:12 UTC. -- Jul 20 14:33:20.241166 dv-cinder-849022-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 14:33:20.249531 dv-cinder-849022-4-smb devstack@keystone.service[92074]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 14:33:20.252210 dv-cinder-849022-4-smb devstack@keystone.service[92074]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 14:33:20 2022] *** Jul 20 14:33:20.252368 dv-cinder-849022-4-smb devstack@keystone.service[92074]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 14:33:20.252476 dv-cinder-849022-4-smb devstack@keystone.service[92074]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 14:33:20.252587 dv-cinder-849022-4-smb devstack@keystone.service[92074]: nodename: dv-cinder-849022-4-smb Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: machine: x86_64 Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: clock source: unix Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: pcre jit disabled Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: detected number of CPU cores: 4 Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: current working directory: / Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: detected binary path: /usr/bin/uwsgi-core Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: your processes number limit is 47680 Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: your memory page size is 4096 bytes Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: detected max file descriptor number: 2048 Jul 20 14:33:20.252702 dv-cinder-849022-4-smb devstack@keystone.service[92074]: lock engine: pthread robust mutexes Jul 20 14:33:20.253239 dv-cinder-849022-4-smb devstack@keystone.service[92074]: thunder lock: enabled Jul 20 14:33:20.253239 dv-cinder-849022-4-smb devstack@keystone.service[92074]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 14:33:20.253239 dv-cinder-849022-4-smb devstack@keystone.service[92074]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 14:33:20.297609 dv-cinder-849022-4-smb devstack@keystone.service[92074]: Python main interpreter initialized at 0x5576a24509c0 Jul 20 14:33:20.297609 dv-cinder-849022-4-smb devstack@keystone.service[92074]: python threads support enabled Jul 20 14:33:20.297609 dv-cinder-849022-4-smb devstack@keystone.service[92074]: your server socket listen backlog is limited to 100 connections Jul 20 14:33:20.297609 dv-cinder-849022-4-smb devstack@keystone.service[92074]: your mercy for graceful operations on workers is 90 seconds Jul 20 14:33:20.298028 dv-cinder-849022-4-smb devstack@keystone.service[92074]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 14:33:20.298106 dv-cinder-849022-4-smb devstack@keystone.service[92074]: *** Operational MODE: preforking *** Jul 20 14:33:20.298348 dv-cinder-849022-4-smb devstack@keystone.service[92074]: *** uWSGI is running in multiple interpreter mode *** Jul 20 14:33:20.298348 dv-cinder-849022-4-smb devstack@keystone.service[92074]: spawned uWSGI master process (pid: 92074) Jul 20 14:33:20.298559 dv-cinder-849022-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 14:33:20.300353 dv-cinder-849022-4-smb devstack@keystone.service[92074]: spawned uWSGI worker 1 (pid: 92083, cores: 1) Jul 20 14:33:20.300353 dv-cinder-849022-4-smb devstack@keystone.service[92074]: spawned uWSGI worker 2 (pid: 92084, cores: 1) Jul 20 14:33:20.300353 dv-cinder-849022-4-smb devstack@keystone.service[92074]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 14:33:25.861127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 14:33:25.861127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: from cryptography.utils import int_from_bytes Jul 20 14:33:25.861891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 14:33:25.861891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: from cryptography.utils import int_from_bytes Jul 20 14:33:25.862291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 14:33:25.862291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: from cryptography.utils import int_from_bytes Jul 20 14:33:25.862410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 14:33:25.862410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: from cryptography.utils import int_from_bytes Jul 20 14:33:25.911350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 14:33:25.911557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 14:33:25.911656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 14:33:25.911741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 14:33:25.911812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] command line args: [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 14:33:25.911953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] command line args: [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 14:33:25.912041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 14:33:25.912188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ================================================================================ {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 14:33:25.912281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 14:33:25.912395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ================================================================================ {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 14:33:25.912484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] admin_token = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.912676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] admin_token = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.912773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] config_dir = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.912921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] config_dir = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] config_source = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] debug = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] config_source = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] debug = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.913816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.914983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_config_append = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_config_append = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.915964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_dir = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_dir = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_file = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_file = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.916919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.917899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.918927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.919772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.919911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.919990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] publish_errors = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] publish_errors = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.920986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] standard_threads = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] standard_threads = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.921818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.922577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.922718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.922851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] use_journal = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] use_journal = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] use_json = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] use_json = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] use_stderr = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] use_stderr = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] use_syslog = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.923985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] use_syslog = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.924091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.924193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 14:33:25.924291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.924911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.925914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.926901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.927928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.928961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.929936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.930963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.931942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.932976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.933988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.934920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.936929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.937026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.937128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.937256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.937371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.937485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.938972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.939995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.940914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.941940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.942988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.943941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.944868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.945999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.946940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.947925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.948862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.external = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.external = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.949912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.password = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] auth.token = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.password = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] auth.token = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.950965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.951923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.952953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.953067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.953822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.953949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.954880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.955976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.956918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.957981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.958911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.959944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960539 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.960889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.961935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.962969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.963921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.964973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.965904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.966951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.967967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.968912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.969934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.970989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.971938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.972890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.973928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.974985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.975932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.976051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.976168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.976538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.976695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.976826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.977946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.978999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.979969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980332 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.980915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.981960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] role.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.982938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] role.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] role.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] role.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.983895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.984940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.985993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.986799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.987970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.988902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.989934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.990987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.991937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.992974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.993997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.994932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.connection = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.connection = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.995920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.996956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.997892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.998950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 14:33:25.999786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 14:33:25.999786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 14:33:26.031691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.031898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.032050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.032135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.032212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.032389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.040952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.041092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.070892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.071134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.071512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.071753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.216511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.218131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.268066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.268357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.268883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.269126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.335906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.336136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.336243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.336322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.336397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.336506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.363908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.364543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.376747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.376933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.390939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.391011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.391128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.391211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.391350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92083) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.391434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 14:33:26.409395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.409600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 14:33:26.409834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.409937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.410058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 14:33:26.410139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 14:33:26.410363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.410461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.410587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 14:33:26.410679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.410851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.410937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.411111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.411203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.411372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.411653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.423965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.424107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.424393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.432136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.432642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.435417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.435808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.436007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.436140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.436414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.436498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.436811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.436932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.437902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.438985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.439260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.464914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.465999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.466590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.466812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.467671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.467962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.472794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.473069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.473349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.473810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.474094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.474377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.481025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.481309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.482049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.482340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.486223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.486505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.486781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.487333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.487976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.488156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.488238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.488470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.488742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.489012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.507432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.507745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.508330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.508627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.512303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.513287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.517468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.517468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.517807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.517992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.522062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.522923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.525728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.526695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.530718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.530718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.530718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.530718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.531738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.531863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.531956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.532033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.532107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.532107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.532107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.532107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.550124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.550519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.551005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.551091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.551406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.551706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.551976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.558987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.559985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.560709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.560984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.561735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.563510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.564877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.565163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.565441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.565633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.565922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.566017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.566209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.566498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.566847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.580123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.580407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.580692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.580982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.581126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.581258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.581426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.581552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.581709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.581811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.582051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.582273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.582563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.582844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.601735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.602804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.605066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.606178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.608398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.609588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.610056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.611227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.611827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.612112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.612399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.612897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.613184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.613476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.619780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.621049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.621385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.622675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.624677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.624966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.625805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.626084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.626500 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.626797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.627087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.627379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.635435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.635748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.636022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.636756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.637054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.637340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.644045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92083) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.644327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.644606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.644878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.645150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.645426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 14:33:26.645519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.645697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.645778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.645970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.646860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92083) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.647890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.648166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.648438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.648706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.649022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 14:33:26.686447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576a24509c0 pid: 92083 (default app) Jul 20 14:33:26.688129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576a24509c0 pid: 92084 (default app) Jul 20 14:33:26.690650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f749-fe3c-42ad-80cc-c98ab98b78c4 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:26.690943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f749-fe3c-42ad-80cc-c98ab98b78c4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:26.691221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f749-fe3c-42ad-80cc-c98ab98b78c4 None None] PATH_INFO: `/v3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:26.695566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed Jul 20 14:33:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:34.584370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:34.584953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:34.584953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:34.589333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:34.595018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:34.595558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:34.595661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:34.664998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: INFO dbcounter [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] Registered counter for database keystone Jul 20 14:33:34.687244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG oslo_db.sqlalchemy.engines [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 14:33:34.695870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writer thread running {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 14:33:34.881837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG passlib.handlers.bcrypt [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92083) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 14:33:34.882168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG passlib.handlers.bcrypt [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92083) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 14:33:34.937597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:34.939874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:35.074476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 14:33:35.266251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:35.340020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: INFO dbcounter [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] Registered counter for database keystone Jul 20 14:33:35.361641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG oslo_db.sqlalchemy.engines [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 14:33:35.368559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writer thread running {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 14:33:35.492847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca487f7a-e69e-4524-9be0-bfb66bd87497 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:35.497198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:35.497872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:35.498158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:35.498438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:35.507129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:35.559881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 14:33:35.560230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40a0d3-00cb-4ec1-b13f-571897536a6b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:35.570662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Jul 20 14:33:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:33:35.576726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:35.591764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1176ab-6e79-4c45-9b80-486f923b04b2 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:35.596885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:35.598049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:35.598337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:35.598604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] PATH_INFO: `/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:35.603073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d2c10ce8e0d4f8ab9d78c156b64a59e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:35.654005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 14:33:35.654351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5201767-a36d-47e1-8c5a-1b0abd399847 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:35.660315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Jul 20 14:33:35 2022] GET /identity/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:37.797081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a9bf-33b1-4061-aa2a-c64ed1aaacec None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:37.798094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a9bf-33b1-4061-aa2a-c64ed1aaacec None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:37.798326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a9bf-33b1-4061-aa2a-c64ed1aaacec None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:37.802892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:37.808854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:37.809340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:37.809431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:37.828744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:37.830337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:37.838383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 14:33:37.862011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a9bf-33b1-4061-aa2a-c64ed1aaacec None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:37.874225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a9bf-33b1-4061-aa2a-c64ed1aaacec None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:37.880227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:37.880865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:37.881149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:37.881425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:37.889569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:37.891397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c687e-431d-4608-883a-7abd3e2c5156 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:37.900301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Jul 20 14:33:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 14:33:37.906124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:37.915969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195f58-6e85-461c-a556-319d106784c1 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:37.920891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:37.921785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:37.922072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:37.922414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:37.925524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:37.928050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0cc38-c54e-47d7-9b3d-27dbfb912079 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:37.930813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed Jul 20 14:33:37 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:40.077706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5f99-7959-4e83-b5d6-431d5e14a218 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.078223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5f99-7959-4e83-b5d6-431d5e14a218 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.078324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5f99-7959-4e83-b5d6-431d5e14a218 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.081043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:33:40.086050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.086505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.086583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.105655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:40.105956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cea0fc-c246-4081-a339-da92595e086c None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.105956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cea0fc-c246-4081-a339-da92595e086c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.106254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cea0fc-c246-4081-a339-da92595e086c None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.106880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:40.107587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:33:40.113085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.113376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.113660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.155984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG passlib.handlers.bcrypt [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92084) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 14:33:40.156451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG passlib.handlers.bcrypt [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92084) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 14:33:40.200736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:40.203005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:40.204794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:40.223951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.250562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:40.328269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:40.341587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4057-fa5a-4f5f-82ba-1a0b0167b7e0 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.351315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.379777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.380611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.380901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.381188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.393243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:40.404741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:40.405888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:33:40.406823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:33:40.412982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.462343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3568f3-d3ee-4534-8dde-50f151f61d77 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.464933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:40.503859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.504766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.505056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.505334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.508664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:40.535912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66a23c-92ef-4dbc-9352-ec6a3b2a0bfd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.573881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.574569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.574858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.575138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.575954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:40.576300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:40.577724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:40.581477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:40.582974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:40.590597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:40.597017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.689794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 14:33:40.695717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.698691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:40.707211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44c14-d73e-4a36-b3f4-dfde05f8212a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.745340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.746653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.746985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.747437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.748706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:40.750328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:40.752361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:40.758113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.774290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:40.805634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bce7b-2a34-42e3-a5e6-e780a9f3cb69 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.850171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.850895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.851179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.851537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.865187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f787b6-c620-4d8b-8d9a-8231a0858282 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:40.871007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:40.872543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:33:40.894887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:40.895981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:40.896928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:33:40.896928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:33:40.896928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:33:40.896928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:40.896928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:33:40.902466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.904919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:40.905754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:40.906044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:40.906322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:40.908153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:40.909648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:40.911316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:40.919893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:40.974039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:41.012251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:41.022103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59506-a38c-4e10-a8d5-6d80077f2956 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:41.040716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda2f4-e541-4355-b0aa-d3f6ab0ece97 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:41.058069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:41.058751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:41.059039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:41.059371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:41.060108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:41.060426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:41.061840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec48fce-8f75-473a-98dd-2b03aeec4ed5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:41.080820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:41.081461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:41.081605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:41.082017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:41.082088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:41.082997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.domain.id=default, user.id=dca8d47aa90c480bb8c128187af71164) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:41.083315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:41.084871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afe8c-6728-49c6-a0d8-1e8938e0b700 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:41.093628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Jul 20 14:33:40 2022] GET /identity/v3/role_assignments?user.id=dca8d47aa90c480bb8c128187af71164&scope.domain.id=default&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 233 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:43.578195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb9a5-2968-4907-a435-16bf5c41646f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:43.579213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb9a5-2968-4907-a435-16bf5c41646f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:43.579709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb9a5-2968-4907-a435-16bf5c41646f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:43.581582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:43.588889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:43.589852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:43.590387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:43.616565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:43.617792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:43.641798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd28d8-1b26-4522-92f9-ec46d39d5b35 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:43.642456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd28d8-1b26-4522-92f9-ec46d39d5b35 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:43.642968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd28d8-1b26-4522-92f9-ec46d39d5b35 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:43.644608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:33:43.650448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:43.651041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:43.651563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:43.688697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:43.690271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:43.760963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:43.818091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:43.826723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:43.872002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:43.972005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.041315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.100602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2215ece-9f07-4c7a-b5b1-eb1d8971c9a3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.102797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59a6e5-3c9a-4420-b024-9cbe0d360a70 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.178650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.179831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.180243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.180404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.180804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.181397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.181774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.182147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.203766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.205947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.212925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:44.229716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:44.230596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:33:44.231349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 13/26] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:33:44.235090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:44.236594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:44.237448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:33:44.237448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:33:44.237448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:33:44.237448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:44.237448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 14/27] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:44.239298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.244676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.431023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac3091-450e-4c6e-8586-ebdfa66441b1 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.467395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.469595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b4fde-9b27-4df8-84f9-117bd015ef4a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.472212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.473821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.474326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.474792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.475809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:44.476318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.478300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e0609-81fa-4805-8a43-6cf49bc1a236 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.480249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.490387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:44.492075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754b4a-cea0-4abf-ac21-ddefba64f87d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.492587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754b4a-cea0-4abf-ac21-ddefba64f87d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.493065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e754b4a-cea0-4abf-ac21-ddefba64f87d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.494523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:44.496153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a1970-04d6-462d-9678-5030fdb8beba None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.496660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a1970-04d6-462d-9678-5030fdb8beba None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.497137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a1970-04d6-462d-9678-5030fdb8beba None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.498680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:44.499600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a1970-04d6-462d-9678-5030fdb8beba None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.519319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.520356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.520812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.521387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.522333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:44.522806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.524440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a147e5-ee92-45f6-8ab4-a8450a5a8491 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.538308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:44.540090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b507-d043-495c-86a1-831ef16025f9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.540579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b507-d043-495c-86a1-831ef16025f9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.541037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b507-d043-495c-86a1-831ef16025f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.558915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2ac8b507-d043-495c-86a1-831ef16025f9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:44.560453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2ac8b507-d043-495c-86a1-831ef16025f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:44.635092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:44.637304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.637799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.638578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.644193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a1970-04d6-462d-9678-5030fdb8beba None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.666507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:44.668233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:44.690435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.691500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.691948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.692376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.693928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.696154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.698466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:44 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:44.699551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.759577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:44.760803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:44.779729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.815991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:44.819103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00a83-3b98-43c2-bc9d-219895d86aad None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.860020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.861111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.861554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.861977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.862948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.864811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:44.887912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0341-6788-45a6-9c7b-a52d6fbca0a1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:44.929537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:44.930232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:44.930520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:44.930803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:44.931644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:44.933045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.067923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:33:44 2022] POST /identity/v3/projects => generated 301 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:45.069833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.093635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Jul 20 14:33:44 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:45.094720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.206024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:45.235287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7ac9-f491-49c1-b890-3d409b8b4dc9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:45.283879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:45.284744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.285096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.285451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.286718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:45.288139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155a80e-3626-4417-abde-f3aa9c4f00b6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.303944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ec356-fb81-4d9b-8ea8-155173c508fa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:45.305076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Jul 20 14:33:45 2022] POST /identity/v3/roles => generated 225 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:45.306770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93b8f-1567-4b16-a566-ef8c68f82196 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.307135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93b8f-1567-4b16-a566-ef8c68f82196 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.307525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd93b8f-1567-4b16-a566-ef8c68f82196 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.315493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 20/38] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:45.315493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef1f8-24da-445d-a0da-b02f260acfef None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.315493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef1f8-24da-445d-a0da-b02f260acfef None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.315493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ef1f8-24da-445d-a0da-b02f260acfef None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.315493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 21/39] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:45.317055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.317294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.317809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.340161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:45.341790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:45.354099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:45.403836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:45.404684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.404981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.405319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.406809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:45.408685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dcd0a-b13f-4efc-9eae-2bcc6e55fa0e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.412890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 19/40] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:45.420434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.420776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.421032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.446790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:45.447740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.452763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:45.456075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:45.559384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:45.580439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 20/42] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:45.581861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.600454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28564154-04c6-4d2f-ae44-e96f10f08ec9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:45.648148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:45.649044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.649337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.649624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] PATH_INFO: `/v3/domains/default/users/dca8d47aa90c480bb8c128187af71164/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.652158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dca8d47aa90c480bb8c128187af71164, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:45.653655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.672151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1361 bytes} [Wed Jul 20 14:33:45 2022] PUT /identity/v3/domains/default/users/dca8d47aa90c480bb8c128187af71164/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:33:45.672723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.723862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834ff92-6536-4f9e-926c-f09d238e477f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:45.818455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195841f-f524-499a-abf3-76c5b60d342d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:45.858587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:45.859148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:45.871527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:45.872243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.872540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.872830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.873619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:45.875061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f263ce2-c1ca-45cc-8acc-6dfc0da36dec None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.881876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:45.882844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:45.883141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:45.883413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:45.884738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:45.886225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:45.888212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 21/44] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:45.894174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:45.894840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 24/45] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Jul 20 14:33:45 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:46.039807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b320d5-ddf3-47e4-9def-9933513f23d5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:46.084615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:46.085300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:46.085586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:46.085867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:46.086609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:46.088121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507237f-812f-4547-8edd-08d93dbfda4e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:46.122142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:33:45 2022] POST /identity/v3/projects => generated 312 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:33:47.798388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ba51b-3b7a-4d11-8957-3ce4532d752f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:47.798883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ba51b-3b7a-4d11-8957-3ce4532d752f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:47.798883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ba51b-3b7a-4d11-8957-3ce4532d752f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:47.800376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:47.806213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806326b-7983-4bd2-955e-5417328a58e2 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:47.806695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806326b-7983-4bd2-955e-5417328a58e2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:47.806835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806326b-7983-4bd2-955e-5417328a58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:47.826857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5806326b-7983-4bd2-955e-5417328a58e2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:47.828125 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5806326b-7983-4bd2-955e-5417328a58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:47.862008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:47.907549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:47.931089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ba51b-3b7a-4d11-8957-3ce4532d752f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.152765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ba51b-3b7a-4d11-8957-3ce4532d752f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.190557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.191366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.191688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.191974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.196819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212459bf-f2e3-4c76-901e-90b9309b7c67 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.197120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212459bf-f2e3-4c76-901e-90b9309b7c67 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.197408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212459bf-f2e3-4c76-901e-90b9309b7c67 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.198814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 24/49] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:48.204105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.204374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:48.204496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.204763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:48.213526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:48.214580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:48.215569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 26/50] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:48.220653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.225897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:48.227116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:48.273525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:48.300306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 25/51] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:48.324111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.333580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdb0e-352f-48ba-ab06-509082b953d8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.372497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.373175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.373463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.373745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.374514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:48.374830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.376305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.389429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:48.395175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.431560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:48.441382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e9019-4b23-417f-91f6-7319789e4de3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.477758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.478832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.479388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.479388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.480840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.482347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.484260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:48.490417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.505918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6901f-18a5-448e-964f-3bcd7045223a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.517282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:48.555094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde93b-110f-4782-a099-445d93189892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.556045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde93b-110f-4782-a099-445d93189892 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.556338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde93b-110f-4782-a099-445d93189892 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.556621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde93b-110f-4782-a099-445d93189892 None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.557892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde93b-110f-4782-a099-445d93189892 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.559394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde93b-110f-4782-a099-445d93189892 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.561115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:48 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:48.566843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde93b-110f-4782-a099-445d93189892 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.605821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3840-37a5-4955-b765-d710ce9002f6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.646130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.647190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.647509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.647799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.648870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.650382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.672334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde93b-110f-4782-a099-445d93189892 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.680899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 27/55] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Jul 20 14:33:48 2022] POST /identity/v3/projects => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:33:48.711996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.712827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.713123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.713411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.714759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.716341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1eae0-4879-4cb3-bfb4-f84e41b52bad None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.718086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:33:48.724772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:48.745739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:48.847172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494bcd-5666-42e9-8612-ad10b13860b4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:48.884074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:48.884782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:48.885071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:48.885353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:48.886219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.domain.id=default, user.id=dca8d47aa90c480bb8c128187af71164) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:48.886543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:48.888041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff426aa-046c-4482-9459-83b1e130d4ed None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:48.897173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Jul 20 14:33:48 2022] GET /identity/v3/role_assignments?user.id=dca8d47aa90c480bb8c128187af71164&scope.domain.id=default&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 530 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:50.773088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49205eb-2de4-4aa6-80fe-659a7265a47b None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:50.773646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49205eb-2de4-4aa6-80fe-659a7265a47b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:50.773646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49205eb-2de4-4aa6-80fe-659a7265a47b None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:50.775043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:50.780748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:50.781224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:50.781354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:50.799814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:50.801015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:50.872419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:50.897317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49205eb-2de4-4aa6-80fe-659a7265a47b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:50.948847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:51.006280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49205eb-2de4-4aa6-80fe-659a7265a47b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:51.044901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:51.045766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:51.046096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:51.046438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:51.047931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:51.049844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f1ad7-c09d-4482-a85a-396db6fe4d6f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:51.051832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:51.058338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:51.070303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:51.163394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a8c02-a49e-492b-a7ab-59c8bf1f8326 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:51.201014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:51.202290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:51.202290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:51.202488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:51.203082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:51.204755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc661cd-91ea-49bb-9ce8-4f2530374379 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:51.230427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:33:51 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:54.527240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d2106-403d-45f6-b3d8-5631041e2bb9 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.527784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d2106-403d-45f6-b3d8-5631041e2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.527862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d2106-403d-45f6-b3d8-5631041e2bb9 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.529206 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:54.546480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba93d5-0819-4d5d-8ca7-1a5dc54df6c8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.547002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba93d5-0819-4d5d-8ca7-1a5dc54df6c8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.547198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba93d5-0819-4d5d-8ca7-1a5dc54df6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.572188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ebba93d5-0819-4d5d-8ca7-1a5dc54df6c8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:54.573407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ebba93d5-0819-4d5d-8ca7-1a5dc54df6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:54.667986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:54.680319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:54.721620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d2106-403d-45f6-b3d8-5631041e2bb9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:54.731619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2369-be64-4a66-909b-98db9a474046 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.732488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2369-be64-4a66-909b-98db9a474046 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.733169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2369-be64-4a66-909b-98db9a474046 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.734906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:54.741466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7949f-b7e3-4dd2-882d-82993536ec11 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.742053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7949f-b7e3-4dd2-882d-82993536ec11 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.742553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7949f-b7e3-4dd2-882d-82993536ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.764710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eba7949f-b7e3-4dd2-882d-82993536ec11 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:54.766288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eba7949f-b7e3-4dd2-882d-82993536ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:54.862261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d2106-403d-45f6-b3d8-5631041e2bb9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:54.866624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:54.868255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e5b6c-3c97-4898-9dc0-de8273071609 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.868548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e5b6c-3c97-4898-9dc0-de8273071609 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.868830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e5b6c-3c97-4898-9dc0-de8273071609 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.870165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 34/66] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:54.875624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.876195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.876729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.884530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:54.894369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:54.895851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:54.919169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:54.920345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:54.920831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:54.921285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:54.937619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:54.946643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:54.947545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:33:54.948585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:54.953019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 33/67] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:54.954133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:54.994411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 35/68] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:33:54.995390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.085213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.101004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53d01-e0f0-4d3c-83cf-d8dfba28da68 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.147212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.148867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.149464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.150024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.152345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd954-04bf-45a0-8a84-58437ced4c5b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.170680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:55.188278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:55.190375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:33:55.191566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:55.197194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:55.198071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.227041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.227800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.228094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.228493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.230365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:55.230603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.233100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e3864-3eea-4396-bf8d-11d795a78dc1 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.241253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:33:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154068-0d7f-4e3f-9bbd-0f6eb6c143fa None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154068-0d7f-4e3f-9bbd-0f6eb6c143fa None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48154068-0d7f-4e3f-9bbd-0f6eb6c143fa None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 37/71] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:55.251411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154068-0d7f-4e3f-9bbd-0f6eb6c143fa None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.339023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e6d-d38e-4cb4-abd6-f53f792f674e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.377603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.378421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.378705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.378998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.389862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:55.398548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:55.399396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:33:55.400197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 35/72] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:55.400807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.411793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48154068-0d7f-4e3f-9bbd-0f6eb6c143fa None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.431619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.451007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.451727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.452144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.452431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.453208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:55.453532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.454961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb67bf-d5dc-452b-8ab5-0c53a70065af None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.464180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 38/73] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.468871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff96c-7644-4a94-9e71-ba5f6f4bd7a3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.468871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff96c-7644-4a94-9e71-ba5f6f4bd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.468871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffff96c-7644-4a94-9e71-ba5f6f4bd7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.483670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1ffff96c-7644-4a94-9e71-ba5f6f4bd7a3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:55.484915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1ffff96c-7644-4a94-9e71-ba5f6f4bd7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:55.508408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.519266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266408-4376-4470-95fb-0b081d283158 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.566261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 39/74] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:55.570947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.571870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.572159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.572442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.573433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979a68-b491-42cb-a586-9ce144f03f00 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.573734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979a68-b491-42cb-a586-9ce144f03f00 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.574022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979a68-b491-42cb-a586-9ce144f03f00 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.576741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 40/75] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:55.577390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979a68-b491-42cb-a586-9ce144f03f00 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.593326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.594847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.598382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.598382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.707977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979a68-b491-42cb-a586-9ce144f03f00 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.718426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ba080-e391-4a57-af07-2294f34fbb5e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.718656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.754002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.754793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.755067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.755335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.756154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:55.756457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.757889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac981aa-8975-45a1-bb7b-f49d2dc72286 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.761735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.762626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.762914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.763191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.764743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.765998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.767773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 41/77] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.774910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.774910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.775160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.775160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.775160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.791007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:55.792262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:33:55.802392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.878011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 42/79] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:33:55.878897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.905906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6d55-14c3-47e9-be39-f8adf7fba634 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:55.948136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:55.949457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:55.949975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:55.950449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:55.954519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:55.954519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:55.956183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 38/80] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:55.956993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:55.990734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:55.993727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7d4a2-cfb0-4ec6-9a7f-cb14f478c13f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.037949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.038667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.038946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.047551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.060770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.081203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e3b5-97cb-4fa6-bc41-30ab1488520e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.122879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.123084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.124073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.124402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.124731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.124823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.126082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.128108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.130046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 39/81] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:56.130590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.260796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a93dc-6602-4438-854f-a22d17da8360 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.262494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.267179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 43/82] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:33:56.268211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.301829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.302505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.302793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.303079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.328706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.382562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d6b-61a1-4b7d-ac94-63e776ea5f50 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.384114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.385635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.419906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.420725 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.421011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.421293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.433420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:33:56.441878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:33:56.443576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:33:56.445173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 44/83] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:33:56.446406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.494455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 40/84] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:33:56.495322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.512943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.557168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.568719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02896dd-bc96-4cb7-9d6e-dd7072fc7bf7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.605227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621bf30-dfd6-4714-ab95-1419c9aca1e0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.607353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.608085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.608370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.608650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.609389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.610845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.632065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 45/85] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:33:56 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:33:56.632835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.653082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.653771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.654065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.654350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.744197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.745719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.772730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fb1c-17ff-47e1-a51c-2c5a18158a2d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:56.794366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.817919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:56.824552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:56.825851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:56.825851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:56.826012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:56.835421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:56.835421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:56.835421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 46/86] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:56.835421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.896576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 41/87] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:33:56.897474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:56.991607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e5582-76d6-4454-b9d6-2228abe6c3a8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.055251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.056680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.057192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.057698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.059004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:57.060115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.062522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.070633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87fef-3ff4-414e-816e-5457f6662d34 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.075059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 47/88] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.076482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.114572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.115549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.115791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.116073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.117354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.118858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.120688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:33:56 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.121492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.136468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:57.152913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:57.214232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641fb5-451e-46b9-8bb6-2127cf7ce7c5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.251745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8789e-0ef2-4b9d-b27b-fada4f975b9e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.259654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.260489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.260777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.261056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.261917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:57.262247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.263899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.271258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=c0d3425b913b4de780118a257ec996d2 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.272157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.306773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.308098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.308647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.309133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.310844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.312740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.315021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 43/91] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.316404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.416567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ccdbb-0d71-4fdc-8597-9e970e607021 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.429510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:57.471710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.472753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.473125 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.473409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.474743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.476392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.480085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 49/92] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.480842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.523764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:57.541161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5effc0-5cd2-4341-86de-3bf4604309c5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.610277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.612021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.612602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.613129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.614231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=dca8d47aa90c480bb8c128187af71164) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:57.614765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.617478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.636042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 44/93] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/role_assignments?user.id=dca8d47aa90c480bb8c128187af71164&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.640140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:57.667753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5acc2-203a-4f51-b67d-5c15722f533d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.740977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.742231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.742529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.742820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.743755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:57.744094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:57.746246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:57.761955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 50/94] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=d4da261147b04e7288ffb922c442bf0e => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:57.896505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9346-da93-488d-b4b7-33b81482364a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:57.949075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:57.949760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:57.950049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:57.950334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:57.992394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:58.051954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:58.053499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:58.208352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:33:58.214744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:58.295895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:58.380664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89d80d-e1af-4c9b-b8b5-cd2227752b62 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:58.420400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:58.421295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:58.421579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:58.421864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] PATH_INFO: `/v3/projects/825240861d6149c5bc5bf13255b38f13` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:58.423118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] RBAC: Authorizing `identity:get_project(project_id=825240861d6149c5bc5bf13255b38f13)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:58.424731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3147ff-bd23-4e3a-937a-f56283ad710f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:58.426752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 51/96] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:33:58 2022] GET /identity/v3/projects/825240861d6149c5bc5bf13255b38f13 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:58.433715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:33:58.543330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:33:58.608829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4404-0346-4921-919d-df0a791c1c2d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:33:58.658701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:33:58.659381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:58.659693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:58.659975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:58.660833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=825240861d6149c5bc5bf13255b38f13, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:33:58.661154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:33:58.662608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c3af-3f66-4037-b7b8-e21d6976f354 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:33:58.672254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 46/97] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:33:58 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=825240861d6149c5bc5bf13255b38f13&role.id=c0d3425b913b4de780118a257ec996d2 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:33:59.883313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d235c-8c8f-4444-8f99-589f2fe0e309 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:59.884042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d235c-8c8f-4444-8f99-589f2fe0e309 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:59.884420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d235c-8c8f-4444-8f99-589f2fe0e309 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:59.886719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 52/98] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:33:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:33:59.892306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2741-04d7-4c79-a07c-01ba2061172f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:33:59.892811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2741-04d7-4c79-a07c-01ba2061172f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:33:59.892999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c2741-04d7-4c79-a07c-01ba2061172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:33:59.921550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-875c2741-04d7-4c79-a07c-01ba2061172f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:33:59.922914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-875c2741-04d7-4c79-a07c-01ba2061172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:00.036433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 47/99] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:00.038064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263e9ac-abc4-4cf5-972e-7ba54c66259c None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.038318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263e9ac-abc4-4cf5-972e-7ba54c66259c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.038602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263e9ac-abc4-4cf5-972e-7ba54c66259c None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.040289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 53/100] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:00.046034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb338304-3e7c-4556-ba35-5e00b0a8f66e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.046336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb338304-3e7c-4556-ba35-5e00b0a8f66e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.046622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb338304-3e7c-4556-ba35-5e00b0a8f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.069017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-eb338304-3e7c-4556-ba35-5e00b0a8f66e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:00.070249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-eb338304-3e7c-4556-ba35-5e00b0a8f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:00.082243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263e9ac-abc4-4cf5-972e-7ba54c66259c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:00.163169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:00.194128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 48/101] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:00.195554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4e82-8808-4b8b-a354-00e6a41c433a None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.195910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4e82-8808-4b8b-a354-00e6a41c433a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.196204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4e82-8808-4b8b-a354-00e6a41c433a None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.197756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 49/102] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:00.204748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663787ce-df2b-457b-9936-78961232de1a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.205689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663787ce-df2b-457b-9936-78961232de1a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.205981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663787ce-df2b-457b-9936-78961232de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.227041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-663787ce-df2b-457b-9936-78961232de1a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:00.228349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-663787ce-df2b-457b-9936-78961232de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:00.330913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 50/103] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:00.336071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663787ce-df2b-457b-9936-78961232de1a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:00.486955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263e9ac-abc4-4cf5-972e-7ba54c66259c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:00.492571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663787ce-df2b-457b-9936-78961232de1a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:00.507264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:00.523474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:00.539185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:00.540077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.540457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.540752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.553484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:00.561620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:00.563029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:00.564399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 51/104] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:00.571495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:00.637274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:00.638493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.639025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.639557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.644388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:00.646310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:00.648767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:00.650018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:00.700975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12a2d-e5bb-43b8-81d5-3fce25add339 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:00.749200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:00.749956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:00.750252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:00.750543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:00.764601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:00.774719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:00.775652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 52/106] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:00.776402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:00.813725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:00.924999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d2996-43bb-4637-b6e2-828ceaf7d8e8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:00.942131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe4b-56d9-4184-920a-f95a0bbf87dc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.013846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.014437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.014730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.015016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.015785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.017281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.025570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.026263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.026547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.026826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.027636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:01.027950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.030339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.053122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 55/107] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:01.054045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.081893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 53/108] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:34:00 2022] POST /identity/v3/projects => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:01.082879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.150248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:01.266186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:01.285727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459cc65-c096-4cf4-a5d6-d92e3969f4be None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.290730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79e03-0ed0-48eb-aa98-a8be92ec0465 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.342606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.343573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.343862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.344330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.345209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.346009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.346198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.346296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.346569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.347363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:01.347714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.347818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879cda5-daa1-4ae1-ad77-94f6bde40ae7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.349121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb57a66-d5e2-4ecf-ab35-cde92b36fea3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.351297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 54/109] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:01.354796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0de52-dd56-4132-af41-4e3c5c5df115 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.354796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0de52-dd56-4132-af41-4e3c5c5df115 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.354796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0de52-dd56-4132-af41-4e3c5c5df115 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.354796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 55/110] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:01.355940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345c91-0f1e-4590-bc82-d1e5762eeeec None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.356238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345c91-0f1e-4590-bc82-d1e5762eeeec None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.356525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345c91-0f1e-4590-bc82-d1e5762eeeec None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.358782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 56/111] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:01.366150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1345c91-0f1e-4590-bc82-d1e5762eeeec None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.369243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 56/112] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:01.372429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981067b-084d-4711-a706-323b03ab3f89 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.372940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981067b-084d-4711-a706-323b03ab3f89 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.373424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981067b-084d-4711-a706-323b03ab3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.399321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7981067b-084d-4711-a706-323b03ab3f89 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:01.400751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7981067b-084d-4711-a706-323b03ab3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:01.484637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:01.486087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.486494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.486782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.505066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:01.506272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:01.539808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:01.591541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 58/114] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:01.591541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.613599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1345c91-0f1e-4590-bc82-d1e5762eeeec None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.683678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.684933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.685398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.685816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.687585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.689649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.697605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 57/115] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:01.698857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.736950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:01.742018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81062a08-7ec2-465e-a57d-2c22178268ce None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.792577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712316e3-f278-469a-bf05-540061896073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.793602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712316e3-f278-469a-bf05-540061896073 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.793884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712316e3-f278-469a-bf05-540061896073 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.794163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712316e3-f278-469a-bf05-540061896073 None admin] PATH_INFO: `/v3/users/08ea68c006a24ad58397e18c3989bc3c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.812898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712316e3-f278-469a-bf05-540061896073 None admin] RBAC: Authorizing `identity:get_user(user_id=08ea68c006a24ad58397e18c3989bc3c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:01.814487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712316e3-f278-469a-bf05-540061896073 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:01.816279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 59/116] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/users/08ea68c006a24ad58397e18c3989bc3c => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:01.821554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712316e3-f278-469a-bf05-540061896073 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.848079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:01.862746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe927c2-1ebd-4b3d-94b1-9eb88c8ed572 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:01.904394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:01.905264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:01.905549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:01.905893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:01.918745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:01.927839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:01.929719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 58/117] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:01.931405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:01.969855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712316e3-f278-469a-bf05-540061896073 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.013000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.013832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.014121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.014409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.029256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-5dc5188c-c2c6-4274-b424-5f122b20c4ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:02.038492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:02.039411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:02.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 60/118] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:02.042074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73c53-0b85-4605-a3e2-17569d7c6b72 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.042370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73c53-0b85-4605-a3e2-17569d7c6b72 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.042718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be73c53-0b85-4605-a3e2-17569d7c6b72 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.048923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 61/119] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:02.048923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be73c53-0b85-4605-a3e2-17569d7c6b72 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.050551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.075226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1832c-7aa3-458b-b53e-933ef172a801 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.118658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.119604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.119895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.120179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/users/2abfb209701446c896dcb9124dc4513c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.122450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, user_id=2abfb209701446c896dcb9124dc4513c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.123990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.143490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 59/120] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:01 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/users/2abfb209701446c896dcb9124dc4513c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:02.143490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.159424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.190773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be73c53-0b85-4605-a3e2-17569d7c6b72 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.242008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.242691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.242982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.243268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.278035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f97895-d159-49e6-9098-95943c5ffc40 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.327765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.329208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.329711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.330357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.331165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:02.331505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.333029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.340338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.344191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.346338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:02.346618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b71add-c42d-4d91-8415-87a653ddcb58 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.347443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.473991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.499950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:02.501586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.502592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.503003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.516591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef87bd-7a49-4cb4-82bc-055fb0b443a6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.522707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:02.531494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:02.563484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.563484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.563484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.563484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.565193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:02.565841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.567592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.578562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 61/123] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:02.579337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.625257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 63/124] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:02.626491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.662483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.709793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4583-0c17-4423-be86-314ac5ce7fc1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.748220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.749205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.749504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.749789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.751066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.751280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b31620-8524-4b8d-99e8-da40b43db7f3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.752673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.754470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 62/125] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:02.759950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.763985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.792878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.794011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.794450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.794863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.796269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.798031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.806345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 64/126] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:02.807622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.874549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1673-3fc5-4b73-98e2-a3e807a9b618 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.905588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:02.913851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.915023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.915518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.916043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.917570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:02.919213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:02.921003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133a5c5-df71-40e6-98e7-22c3ee9cdc23 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:02.921460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 63/127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:02.922522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:02.968433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:02.969250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:02.969534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:02.969811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:02.982365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:02.990916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:02.992031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:02.993024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 65/128] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:02.994018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.040777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:03.046669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b645-216b-4da6-8b7b-20ec27f17602 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.086376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.087522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.087981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.088405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.089938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.093898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.095982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 64/129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:03.097306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.111597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23cfbc-dd9b-4756-86d1-cf843cdb2ba0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.157402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.158740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.159347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.159945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.161379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=08ea68c006a24ad58397e18c3989bc3c) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:03.161937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.164474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.172965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 66/130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:02 2022] GET /identity/v3/role_assignments?user.id=08ea68c006a24ad58397e18c3989bc3c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=8977d59593e349deac60a482ae067640 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:03.180002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:03.181612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.219550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46eb76-921e-4385-bbe1-806219f8f4dd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.259803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.260696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.260990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.261273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.262707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.264528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.266243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 65/131] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:03 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:03.267135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.356283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e56a-4552-42fa-8c05-64ca5a040556 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.358921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:03.403932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.404871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.406025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.406454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.407497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:03.407965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.410577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.426751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 67/132] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:03.427880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.494998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a014-fd25-4774-891d-6f20e18284ce None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.569390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.570677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.571101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.571552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/users/2abfb209701446c896dcb9124dc4513c/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.575112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, user_id=2abfb209701446c896dcb9124dc4513c, role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.581812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.584555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:03.610378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:03 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/users/2abfb209701446c896dcb9124dc4513c/roles/d4da261147b04e7288ffb922c442bf0e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:03.613015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.653806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2c1c-f868-4de0-b5f6-6e6ca7ec00f7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.743997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.745327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.746821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.749344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/users/dca8d47aa90c480bb8c128187af71164/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.753818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, user_id=dca8d47aa90c480bb8c128187af71164, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.756882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b1292-3426-41ba-a747-bf9efb7a59a4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.787584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 68/134] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:03 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/users/dca8d47aa90c480bb8c128187af71164/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:03.796135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cabe1-fb11-405e-90db-a316ca221bd1 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.796822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cabe1-fb11-405e-90db-a316ca221bd1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.797253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cabe1-fb11-405e-90db-a316ca221bd1 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.801259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 69/135] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:03.807567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.808070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.808478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.848351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:03.849926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:03.884217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc7-405f-4748-bc0a-a25d6631551e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:03.895861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:03.942339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:03.943236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:03.943559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:03.943867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:03.945258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:03.946764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:03.949044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 67/136] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:03 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:03.954853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:03.996275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:04.054668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:04.077642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:04.167378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2f32-e675-4f96-a71a-95091cdcb1bc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:04.265436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:04.266670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.267328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.269518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] PATH_INFO: `/v3/projects/825240861d6149c5bc5bf13255b38f13` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.271120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] RBAC: Authorizing `identity:get_project(project_id=825240861d6149c5bc5bf13255b38f13)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:04.273008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:04.276436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 68/138] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:03 2022] GET /identity/v3/projects/825240861d6149c5bc5bf13255b38f13 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:04.282913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:04.305767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d43f2b-c369-4b4a-a287-2f1d6a0ca184 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:04.387134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:04.387974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.388261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.388542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.390565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:04.392106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:04.394376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 71/139] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:04.409277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:04.468504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:04.469528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c815-1723-44f6-99e5-22cfb0459fbb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:04.508384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:04.509700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.510211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.510713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] PATH_INFO: `/v3/projects/825240861d6149c5bc5bf13255b38f13/users/2abfb209701446c896dcb9124dc4513c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.512468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:04.523780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] RBAC: Authorizing `identity:create_grant(project_id=825240861d6149c5bc5bf13255b38f13, user_id=2abfb209701446c896dcb9124dc4513c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:04.525281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59420-82fa-4f7c-aab8-e3ddc4961879 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:04.542868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 69/140] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:04 2022] PUT /identity/v3/projects/825240861d6149c5bc5bf13255b38f13/users/2abfb209701446c896dcb9124dc4513c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:04.544349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7793-d1f1-45ac-aa86-938192e3dd2b None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.544646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7793-d1f1-45ac-aa86-938192e3dd2b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.544939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7793-d1f1-45ac-aa86-938192e3dd2b None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.551198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 70/141] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:04.552945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.553402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.553893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.606062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:04.607358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:04.683160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e752-1a2b-4ad0-8f76-964356431281 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:04.768545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:04.780093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:04.780744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:04.781038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:04.781325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:04.782111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:04.784449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:04.814110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:04.834452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 72/143] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:04 2022] POST /identity/v3/users => generated 283 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:34:04.964689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c717ea7-d6e5-41d7-a200-73c754a56400 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:04.999712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:05.029901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:05.030787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:05.031023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:05.031318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:05.060496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:05.070684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:05.071619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:05.072395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 72/144] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:05.081372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:05.208254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:05.237693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d0ee2-bb21-4b6e-805d-7aaaa8afa5f4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:05.283001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:05.283680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:05.283972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:05.284254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:05.285034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:05.285398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:05.286817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:05.299499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 73/145] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:05.305241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:05.452281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e7e3-22f0-4942-b0a8-1f50b21cb349 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:05.504236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:05.505138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:05.505425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:05.505705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:05.507045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:05.508556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:05.510566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 73/146] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:05 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:05.518408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:05.665886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcd04-b71d-4421-88f5-558554c2adee None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:05.716329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:05.717014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:05.717301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:05.717579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:05.730407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:05.815090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:05.816661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:05.951798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:05.959157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:06.045566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:06.131416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb11e-1909-4b2a-b539-60a618547154 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:06.182365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:06.183261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.183583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.183866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.185138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:06.186605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ff89-ea1b-4711-a842-717bb7e4e675 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:06.188550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 74/148] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:05 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:06.195980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:06.274335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:06.301362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c984c8-6b4c-487d-a6c4-4fdbf72d5069 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.301880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c984c8-6b4c-487d-a6c4-4fdbf72d5069 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.302817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c984c8-6b4c-487d-a6c4-4fdbf72d5069 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.305505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 75/149] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:06.317126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.317443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.317728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.346777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:06.347841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:06.382715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1357c-b799-4ac5-af53-88d89f48beaf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:06.460514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 76/150] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:06.468322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:06.469708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.470292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.470935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.472065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:06.472589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:06.474357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:06.482431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 75/151] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:06 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=c0d3425b913b4de780118a257ec996d2 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:06.501852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:06.615924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:06.673408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8879-f05e-4557-93a1-f370109d2e0e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:06.722573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:06.723394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.723705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.723986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.741209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:06.749392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:06.750292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:06.751018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 77/152] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:06.758023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:06.929596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8a83-c816-436f-88db-6c9213a9e806 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:06.933255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:06.969852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:06.971579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:06.972065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:06.972546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:06.973795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:06.974470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:06.976147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:06.987363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 76/153] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:06.993781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:07.125934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a6e5e-48e4-47dd-a609-28dbd5987f2e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:07.134766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:07.180792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:07.182216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.182666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.183147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] PATH_INFO: `/v3/users/08ea68c006a24ad58397e18c3989bc3c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.184811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] RBAC: Authorizing `identity:get_user(user_id=08ea68c006a24ad58397e18c3989bc3c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:07.186303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:07.188096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 78/154] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:06 2022] GET /identity/v3/users/08ea68c006a24ad58397e18c3989bc3c => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:07.194444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:07.340485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754e8d-e7b2-49f3-8a5c-0168e6103172 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:07.390535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:07.391415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.391726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.392000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.393924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:07.395613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264227f-64b6-4796-b729-dfb2d87d6006 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:07.397508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 77/155] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:07 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:07.403228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:07.525536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164bfd3-28f7-46e3-a00e-91de7e3e0c56 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:07.563171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:07.564111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.564527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.564859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/users/08ea68c006a24ad58397e18c3989bc3c/roles/8977d59593e349deac60a482ae067640` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.566954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, user_id=08ea68c006a24ad58397e18c3989bc3c, role_id=8977d59593e349deac60a482ae067640)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:07.568636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16344ea-cf63-4e46-a0c1-55d9d9726867 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:07.588383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 79/156] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:07 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/users/08ea68c006a24ad58397e18c3989bc3c/roles/8977d59593e349deac60a482ae067640 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:07.746969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed32b3-b43e-42b6-a27e-1d6c18387fa9 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.747329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed32b3-b43e-42b6-a27e-1d6c18387fa9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.747604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed32b3-b43e-42b6-a27e-1d6c18387fa9 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.749206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 78/157] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:07.754729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331148-172a-4ae3-8e04-18ab2cc89971 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.755014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331148-172a-4ae3-8e04-18ab2cc89971 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.755287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331148-172a-4ae3-8e04-18ab2cc89971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.778931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c7331148-172a-4ae3-8e04-18ab2cc89971 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:07.780081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c7331148-172a-4ae3-8e04-18ab2cc89971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:07.825042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:07.889942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 80/158] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:07.939611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed32b3-b43e-42b6-a27e-1d6c18387fa9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:07.961995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74d4-b760-4980-ac9b-34ac4a15c7eb None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.962416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74d4-b760-4980-ac9b-34ac4a15c7eb None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.962702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f74d4-b760-4980-ac9b-34ac4a15c7eb None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.964117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 81/159] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:07.969639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebfd3-492c-4286-9880-3c4a0aa08659 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:07.969923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebfd3-492c-4286-9880-3c4a0aa08659 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:07.970181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebfd3-492c-4286-9880-3c4a0aa08659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:07.998541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-becebfd3-492c-4286-9880-3c4a0aa08659 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:08.004764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-becebfd3-492c-4286-9880-3c4a0aa08659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:08.011664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:08.171869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 82/160] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:08.173839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523405a2-6262-4c17-9d4e-df149257418c None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:08.174421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523405a2-6262-4c17-9d4e-df149257418c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:08.174901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523405a2-6262-4c17-9d4e-df149257418c None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:08.176720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 83/161] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:08.177002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed32b3-b43e-42b6-a27e-1d6c18387fa9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:08.184239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:08.184910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:08.185384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:08.215225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:08.217386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:08.249680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:08.250563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:08.250848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:08.251123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:08.284744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:08.300197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:08.301104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:08.301857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 79/162] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:08.302541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:08.383911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 84/163] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:08.384828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:08.447577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:08.527115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:08.542834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19eaf-6b23-44de-a79a-02173c524bc7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:08.592579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e8e5-36a7-4e50-a97e-0c1c1df1c455 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:08.629201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:08.630511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:08.631087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:08.631605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:08.638319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:08.639310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:08.639864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:08.640357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:08.641769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:08.642253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:08.643756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:08.663840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 85/164] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:08.664952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:08.665562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:08.680809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:08.681751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:08.682558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:08.685216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 80/165] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:08.686452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:08.894535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:08.945509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04880-82ff-4826-a2f5-3f7fcfa749bb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:08.952621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56be239-02d5-461d-834e-db087c8bac05 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.011247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.016168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.016465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.016752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.033026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.033310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:09.033936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.034219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.034491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] PATH_INFO: `/v3/users/dca8d47aa90c480bb8c128187af71164` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.040470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] RBAC: Authorizing `identity:get_user(user_id=dca8d47aa90c480bb8c128187af71164)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.042310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.044079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 81/166] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:08 2022] GET /identity/v3/users/dca8d47aa90c480bb8c128187af71164 => generated 247 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:09.044914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:09.047618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:09.048577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:09.050343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 86/167] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:09.052417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.093224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:09.175833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ad81-bcae-4aac-a77a-e19a3999da05 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.225313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.227883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.228333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.228738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.260712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c8c7-7712-42af-a569-960228b9273d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.263912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:09.307538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.309265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.356881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.357776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.358170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.358552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.359441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:09.359891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.361407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.380257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:09.381398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.437157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 87/169] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:09.438578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.495835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:09.576577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:09.588304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5c624-c41a-4ec7-89f0-4a5616e725ec None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.623546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f19ad-3b48-4948-9506-6609efc4324b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.673215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.675011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.675643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.677289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.681038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.683721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.686373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 88/170] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:09.687642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.712723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.713420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.713708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.713990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.714766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:09.715080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.716549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.733538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 83/171] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:09.734503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.806711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411d0f6-e411-42dd-8f98-1f646ecd28fd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:09.829750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:09.845656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:09.847604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:09.848113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:09.848614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:09.850126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:09.852064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:09.854046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:09.855126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:09.989318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8307da-1cda-47bb-a830-25d8a16ae94e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.002770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a551e-6ebd-4f82-894c-e02d2f5fe63a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.037818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.038827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.039116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.039397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] PATH_INFO: `/v3/users/2abfb209701446c896dcb9124dc4513c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.042625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] RBAC: Authorizing `identity:get_user(user_id=2abfb209701446c896dcb9124dc4513c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.044199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.046156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/users/2abfb209701446c896dcb9124dc4513c => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:10.056392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.101027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.102195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.102484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.102758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.131323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.192276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.194145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243efdf1-9d74-4def-bcc4-baa48ba9f4aa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.204687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.259713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec16b27-dfdc-4d79-90c2-f21a6c89a71a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.297485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.298152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.298437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.298708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.299625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=dca8d47aa90c480bb8c128187af71164) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:10.299941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.301393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.308074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 91/174] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/role_assignments?user.id=dca8d47aa90c480bb8c128187af71164&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:10.311571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.329262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 84/175] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:10.336205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23972-625b-480b-a8d0-d77d4a237601 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.336488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23972-625b-480b-a8d0-d77d4a237601 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.336958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23972-625b-480b-a8d0-d77d4a237601 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.338573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 85/176] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:10.340358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f26d-023d-4ee1-a920-2c87059fea51 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.340831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f26d-023d-4ee1-a920-2c87059fea51 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.341274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f26d-023d-4ee1-a920-2c87059fea51 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.342928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 86/177] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:10.344686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b510-617b-4b72-ba06-21c9108e5440 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.345177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b510-617b-4b72-ba06-21c9108e5440 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.345646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b510-617b-4b72-ba06-21c9108e5440 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.347311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 87/178] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:10.348512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b510-617b-4b72-ba06-21c9108e5440 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.404214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.462465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb833ed-0a41-45b8-ab56-f8945f5bc41e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.477631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b510-617b-4b72-ba06-21c9108e5440 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.507105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.513523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.514685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.515324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.515897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.521207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.522423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.522903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.523373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.524921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.526692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be148cf-dd4b-4fdc-a673-af12ed90fa5f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.528797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 88/179] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:10.534908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06974a-1179-48a3-9def-90461499e9a3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.534908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06974a-1179-48a3-9def-90461499e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.534908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06974a-1179-48a3-9def-90461499e9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.553534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ed06974a-1179-48a3-9def-90461499e9a3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:10.555835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ed06974a-1179-48a3-9def-90461499e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:10.609420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.610924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555035-4d2c-48d7-928d-7368a1ae0300 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.637503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 89/180] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:10.638844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4219-3002-4f9a-a589-ebcdcbc1c7a6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.639133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4219-3002-4f9a-a589-ebcdcbc1c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.639433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4219-3002-4f9a-a589-ebcdcbc1c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.656190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b63b4219-3002-4f9a-a589-ebcdcbc1c7a6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:10.657404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b63b4219-3002-4f9a-a589-ebcdcbc1c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:10.700095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.731243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:10.732614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.732912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.733011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:10.733193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.734960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49c4e-97b1-4c8c-a8a6-362711d648f6 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.735345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49c4e-97b1-4c8c-a8a6-362711d648f6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.735720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49c4e-97b1-4c8c-a8a6-362711d648f6 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.737189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 93/183] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:10.738338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49c4e-97b1-4c8c-a8a6-362711d648f6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.755304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:10.760525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:10.761749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:10.838231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 91/184] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:10.840204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.856946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49c4e-97b1-4c8c-a8a6-362711d648f6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.895469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:10.896146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:10.896435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:10.896718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:10.897583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:10.897898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:10.899380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:10.905727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 94/185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=d4da261147b04e7288ffb922c442bf0e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:10.906570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:10.968646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799290-dc1a-43f8-9f3d-18745ae774f3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:10.972593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.005513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.017798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.018938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.019225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.019707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.036331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:11.036693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba556f48-686b-492f-b53c-e03af1546999 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-34d29479-3b0e-408a-86ca-4530207a0a14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:11.050949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:11.052813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:11.054334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 92/186] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:11.060821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.061178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.061383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.083135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:11.084422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:11.089692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.089866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.090104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.090386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] PATH_INFO: `/v3/projects/825240861d6149c5bc5bf13255b38f13` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.092358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] RBAC: Authorizing `identity:get_project(project_id=825240861d6149c5bc5bf13255b38f13)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.093218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.095001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 95/187] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:10 2022] GET /identity/v3/projects/825240861d6149c5bc5bf13255b38f13 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.097352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.180200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 93/188] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:11.181085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.232601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec6464-5403-4b73-b6c5-aa2abe2b4c6d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.268598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.269538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.269714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.270711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.284829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:11.286624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:11.293241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:11.294339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:11.295133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:11.295793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139846-ced9-4e38-b687-4c913dedbf10 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.295865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 96/189] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:11.295865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.306078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.331731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.332548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.332824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.333101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.334299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.335801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.337458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 94/190] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.338251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.404713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47a2d5-0695-43df-bfca-5a3a30c0cc5c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.440712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.441457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.441746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.442032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.442867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:11.443182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.444710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.453600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 97/191] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.454460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.466221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b0c01-299c-4da6-a286-e850f7bde7f4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.501434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.502098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.502386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.502668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.503551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=825240861d6149c5bc5bf13255b38f13, user.id=2abfb209701446c896dcb9124dc4513c) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:11.503872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.505353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.511463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 95/192] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/role_assignments?user.id=2abfb209701446c896dcb9124dc4513c&scope.project.id=825240861d6149c5bc5bf13255b38f13&role.id=c0d3425b913b4de780118a257ec996d2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.512360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.545177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.561198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.597439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2a748-ee1b-4749-9114-72ed3a0ed586 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.648513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4d79-3b9d-429a-8adb-50f6455419cf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.661188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.661188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.661188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.661188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.676582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:11.684709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:11.685645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:11.686796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 98/193] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:11.687471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.695597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.696310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.696595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.696875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.697646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:11.697964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.699398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.710418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 96/194] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.711294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.810211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9b76-05c2-44ec-a474-101ef971770c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.822969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.838093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2c1ef-52ae-4e08-a41f-9a0396a177db None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:11.838984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:11.847983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.848668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.848953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.849236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.849999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.851469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.878110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:11.878457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 99/195] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:11 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:11.879024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:11.879275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:11.879370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:11.879683 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:11.896991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:11.898558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:11.905293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 97/196] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:11.906342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.032944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50573d55-735c-4c0c-8773-645f50f2abf9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.044367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63fb17-c865-409b-b216-16df250097a8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.085935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.087076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.087554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.088039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.089701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:12.090009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.093231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.095254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.096807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.097095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.097375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.098650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.100168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.101886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 98/197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:12.102684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.105138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 100/198] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:12.108890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.128778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.175415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.250758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf287f-7e9a-47f5-9d06-cff7016a9365 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.253395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b9319-bba1-4260-b618-7edd702c8c42 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.297456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.298488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.298950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.299525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.306481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.307159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.307442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.307820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.397308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.399671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.419339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.421222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.445928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.458946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.543672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 101/199] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 14:34:12.545030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.591131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 99/200] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:12.592442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.669489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dffce-ca42-4ebc-8c04-1e436c4d56d0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.708625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.709520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.709808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.710087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] PATH_INFO: `/v3/users/08ea68c006a24ad58397e18c3989bc3c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.711271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618afcc1-e05b-4da1-88a9-64a5093debcf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.711961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] RBAC: Authorizing `identity:get_user(user_id=08ea68c006a24ad58397e18c3989bc3c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.712967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.714864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 102/201] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/users/08ea68c006a24ad58397e18c3989bc3c => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:12.715695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.727888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.740517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:12.753087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.754282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.754401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.754652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.755967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.757670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.760277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 100/202] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:12.761817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.842581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7ce8-ae0d-439b-a7b3-282af1abe033 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.881790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.882859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6498961-8768-47ac-8b48-389484a07726 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:12.883168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.883688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.884167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.885637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:12.887347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:12.889394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 103/203] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:12.895245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:12.927858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:12.928457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:12.928745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:12.929059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:12.999814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:13.006434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:13.024218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:13.026857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:13.028510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4da6d-033b-4db4-b7a5-c4a731d628c5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:13.073672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:13.074345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:13.074631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:13.074945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:13.075805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=075e1fac6be44fe38a053cb735c35d38) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:13.076804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:13.077611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:13.084781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/role_assignments?user.id=075e1fac6be44fe38a053cb735c35d38&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=d4da261147b04e7288ffb922c442bf0e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:13.085653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:13.168689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 101/205] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:13.184737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:13.318146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e6fe9-8440-482e-a2e3-eb8c1d3c823e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:13.331894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:13.355933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464af5-f60e-413f-935b-30e930142bb5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:13.388237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:13.389177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:13.389597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:13.390020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:13.391013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=075e1fac6be44fe38a053cb735c35d38) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:13.391522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:13.393760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:13.400744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 105/206] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:13 2022] GET /identity/v3/role_assignments?user.id=075e1fac6be44fe38a053cb735c35d38&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:13.407511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:13.407511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:13.407511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:13.407511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:13.410210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:13.413525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e2f31-bfcf-4190-a9e0-f85610f5c8bc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:13.415759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 102/207] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:13 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:13.421674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:13.448755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:13.589616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc746f-24cb-4fc2-bb73-b6e31c9b1009 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:13.627790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:13.628467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:13.628754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:13.629036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:13.629899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, scope.project.id=afadf6473c434e2ea1db289230249662, user.id=08ea68c006a24ad58397e18c3989bc3c) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:13.630216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:13.631707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afa66f-ae6d-4cf7-85a5-8af6e1f9310b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:13.638375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 106/208] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:13 2022] GET /identity/v3/role_assignments?user.id=08ea68c006a24ad58397e18c3989bc3c&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=8977d59593e349deac60a482ae067640 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:14.374387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565107-f81f-4147-b8fd-6731224b08c2 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.374908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565107-f81f-4147-b8fd-6731224b08c2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.374908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565107-f81f-4147-b8fd-6731224b08c2 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.376695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 103/209] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:14.382974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.383477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.383582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.406653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:14.407894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:14.476135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8130-8c0b-43e9-b859-befb6fb38ec6 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.476454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8130-8c0b-43e9-b859-befb6fb38ec6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.476695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8130-8c0b-43e9-b859-befb6fb38ec6 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.478077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 104/210] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:14.483642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.484042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.484395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.491230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 107/211] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:14.502373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:14.504201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:14.520443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:14.523925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:14.580977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 105/212] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:14.606382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:14.660872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef09453-3839-4e88-afb1-37dc77aa48ef None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:14.705792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:14.706110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:14.706912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.707188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.707663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.722577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:14.730084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddd8c-6ab3-4c0c-868a-03de79b0cd59 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:14.734253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:14.735200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:14.736027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 108/213] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:14.743699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:14.772617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:14.773809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.774295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.774794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.776360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:14.778050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:14.780330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 106/214] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:14.792835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:14.859845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:14.891925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53809eb-4872-49ee-b61c-5e6a7ff04ca9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:14.922810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0793-e091-4685-b6b6-9b1920b9b4d2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:14.939602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:14.940885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.941441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.941781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.942383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:14.942708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:14.944332 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:14.954356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 109/215] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:14.960457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:14.971914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:14.972641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:14.972936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:14.973213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:14.973960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:14.975467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:15.001813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 107/216] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:14 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:34:15.095589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bfde1-2eb4-4a17-bb6a-92e974741466 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:15.127992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:15.139313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:15.140264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.140555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.140834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] PATH_INFO: `/v3/users/d91d597b92174c138142c4d4e0115a49` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.158269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] RBAC: Authorizing `identity:get_user(user_id=d91d597b92174c138142c4d4e0115a49)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:15.160683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:15.162779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 110/217] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:14 2022] GET /identity/v3/users/d91d597b92174c138142c4d4e0115a49 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:15.168687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:15.173074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:15.290207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134aef5-425d-44ec-a9e2-71926f8deda7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:15.329882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:15.330557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.331522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.331808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.422983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:15.424618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b587ba2-4dc0-416a-952e-223ac54b9b0d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:15.428710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:15.548505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 108/218] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:15.554364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:15.596499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f868-958c-448a-819c-66c4c352929b None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.596816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f868-958c-448a-819c-66c4c352929b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.597068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73f868-958c-448a-819c-66c4c352929b None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.598802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 109/219] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:15.604398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1ce2-96bd-42cf-9e5d-97ca4259e298 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.604688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1ce2-96bd-42cf-9e5d-97ca4259e298 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.604972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1ce2-96bd-42cf-9e5d-97ca4259e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.630362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-33db1ce2-96bd-42cf-9e5d-97ca4259e298 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:15.632604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-33db1ce2-96bd-42cf-9e5d-97ca4259e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:15.703217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68d55-ef52-482a-b103-7b63e2a56d71 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:15.753339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:15.755112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.755642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.756120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.758645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:15.761785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:15.764531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 111/220] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:15 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:15.771509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:15.810790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 110/221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:15.812296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2c2-da5c-4382-a87f-5fc4059cb49d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.812596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2c2-da5c-4382-a87f-5fc4059cb49d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.812876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2c2-da5c-4382-a87f-5fc4059cb49d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.814519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 111/222] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:15.819806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.820088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.820378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.838085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:15.839341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:15.851852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:15.872093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:15.907864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94306c1-ea36-4f47-af26-e2bc11aeb24d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:15.925944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 112/223] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:15.926836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:15.956818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:15.960577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:15.961953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:15.962435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:15.965012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=d91d597b92174c138142c4d4e0115a49) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:15.965569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:15.968910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:15.978985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 112/224] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:15 2022] GET /identity/v3/role_assignments?user.id=d91d597b92174c138142c4d4e0115a49&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=c0d3425b913b4de780118a257ec996d2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:15.981334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.157648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc96c-2bf7-4971-966f-4ace9ba22c05 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.178665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:16.198616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.199837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.200333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.200814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.215131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:16.225586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642983cd-3b67-4039-a0b1-b5c3c220f5cc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:16.229157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:16.230110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:16.231153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:16.233790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 113/225] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:16.242989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.321611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.322345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.322633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.322910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.388751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:16.405455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eadc9-fa00-4073-898b-d4789159c245 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:16.413708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:16.414668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:16.415444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 113/226] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:16.425200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.461507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.462660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.463262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.463896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.465043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:16.465629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:16.467260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:16.485539 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 114/227] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:16.492613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.501672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:16.581437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:16.639172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975d0cc-6a0a-43a4-9efb-f4e56e8c97a0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.684995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.685700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.685988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.686272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.687053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:16.687369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:16.688985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:16.699066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 114/228] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:16.705232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.820166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:16.834004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f1bb7-2983-4ce0-9771-85caea578a73 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.873807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60a96a-8cfb-4342-a6a2-f6002a3d503f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:16.876315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.877454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.878469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.879847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.881036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:16.882648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:16.888896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 115/229] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:16.890005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:16.968918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:16.969930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:16.970220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:16.970499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:16.976307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:16.977812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:16.980106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 115/230] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:16.985488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:17.009357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423461-2772-4cf1-b8a5-e4cd95062ff3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:17.078820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:17.080431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.082067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.083328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.086337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:17.090047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:17.094369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 116/231] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:17.100322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:17.156039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:17.213130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf724-855a-448a-bd23-25f2cce7a3ba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:17.231858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:17.290763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:17.291679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.291951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.292229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.293616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:17.295087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:17.297003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 116/232] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:16 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:17.306560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:17.330240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a319af-430e-4b0e-a565-8368c64769bd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:17.373582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:17.373582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.373582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.373582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/075e1fac6be44fe38a053cb735c35d38/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.376810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, user_id=075e1fac6be44fe38a053cb735c35d38, role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:17.379205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68a3b-36f8-4ffc-a25b-46a23c857854 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:17.407490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 117/233] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:17 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/075e1fac6be44fe38a053cb735c35d38/roles/d4da261147b04e7288ffb922c442bf0e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:34:17.525741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca2e3-4678-4f63-8641-d600e614bb13 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:17.580794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:17.581621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.582446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.582446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/075e1fac6be44fe38a053cb735c35d38/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.584252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, user_id=075e1fac6be44fe38a053cb735c35d38, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:17.585742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84157d-75e7-4775-9eda-43b5eab0b70f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:17.614274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:17 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/075e1fac6be44fe38a053cb735c35d38/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:17.838203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba44c2-1cfe-4f48-a405-9a062c0a1ef3 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.838673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba44c2-1cfe-4f48-a405-9a062c0a1ef3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.838673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba44c2-1cfe-4f48-a405-9a062c0a1ef3 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.840255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 118/235] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:17.846373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b6c7-64dc-4c5e-a668-0ec41f322b2f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:17.847196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b6c7-64dc-4c5e-a668-0ec41f322b2f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:17.847479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b6c7-64dc-4c5e-a668-0ec41f322b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:17.874925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-94a6b6c7-64dc-4c5e-a668-0ec41f322b2f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:17.874925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-94a6b6c7-64dc-4c5e-a668-0ec41f322b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:17.911251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:17.973703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 118/236] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:18.011162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba44c2-1cfe-4f48-a405-9a062c0a1ef3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:18.058719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65dc7-50b0-4876-9c80-763bfb579b44 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.059069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65dc7-50b0-4876-9c80-763bfb579b44 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.059285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65dc7-50b0-4876-9c80-763bfb579b44 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.060731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 119/237] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:18.068170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.068456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.068741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.100609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:18.105090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:18.159597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:18.213614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 120/238] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:18.233717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba44c2-1cfe-4f48-a405-9a062c0a1ef3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:18.241103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:18.358175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6df28-402b-4e75-b4df-6ae74da85ea9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:18.372183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:18.373066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.373352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.373626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.380267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:18.381764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:18.382480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:18.383501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 119/239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:18.391374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:18.400306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:18.403633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.404358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.405049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.422431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:18.446078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:18.447195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:18.448713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:18.452772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 121/240] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:18.458225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:18.640816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db993a-889c-4bc8-adce-7a3ee89f645d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:18.671733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9ef4-a489-40f6-bfb2-31ce4430328f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:18.684942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:18.686014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.686530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.686991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.687983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:18.689822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31ae8f-1998-4480-b548-4fe542c190f4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:18.713466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:18.714619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.715047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.715503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.716524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:18.716976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:18.717950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 120/241] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:18 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:18.718977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:18.719730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94314be-7fe9-46e8-b69c-1936e6f055ef None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.720032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94314be-7fe9-46e8-b69c-1936e6f055ef None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.720383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94314be-7fe9-46e8-b69c-1936e6f055ef None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.728761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 121/242] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:18.730508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:18.730905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:18.731584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:18.733259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 122/243] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:18.741132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:18.753424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:18.761740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:18.763615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:18.772417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:18.907079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 122/244] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:18.940240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0d56-f66a-495a-a995-fa29d1ad18bc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:18.946747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.024911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.026298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.026776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.027260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] PATH_INFO: `/v3/users/9de0f5db5d1a463a8b7a902586a0b11b` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.052526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=9de0f5db5d1a463a8b7a902586a0b11b)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.055437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.059503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 123/245] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:18 2022] GET /identity/v3/users/9de0f5db5d1a463a8b7a902586a0b11b => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:19.063156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.095055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c1995-f374-4ad0-badd-c974318418d8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.144573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.145594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.145975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.146345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.149354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.161076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:19.166950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:19.172222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:19.173142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:19.173989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:19.178185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 123/246] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:19.183260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.208529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64303d32-141d-4c1d-aeed-4fe8445a3ee7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.256877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.257907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.258387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.258888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.325338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d21a-8996-43f2-89f7-502eeeee5126 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.357265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.359070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.369485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.370234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.370527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.370812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.371764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:19.374316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.376432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.391549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 124/247] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:19.397889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.476276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.493105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.529920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 124/248] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:19.537776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.589853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661913-ea2b-4eb2-abf6-6f661c310817 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.679480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db93dc-b532-4367-a280-66331c6c3cc6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.686898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.688149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.688629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.689092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] PATH_INFO: `/v3/users/d91d597b92174c138142c4d4e0115a49` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.690605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d91d597b92174c138142c4d4e0115a49)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.692299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.694548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 125/249] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/users/d91d597b92174c138142c4d4e0115a49 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:19.699735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.736816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.738827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.739123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.739408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.745029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.747292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.757458 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 125/250] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:19.774088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:19.873599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.889958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61ffa9-3b97-477d-927b-fe34629548c3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.943548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:19.955662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e8603-18f0-48f1-9918-b074eabe4b9c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:19.959674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:19.961627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:19.961627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:19.961627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:19.964340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:19.965859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:19.968065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 126/251] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:19.974405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:20.000846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:20.001980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.002479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.002975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.004186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=9de0f5db5d1a463a8b7a902586a0b11b) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:20.004717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:20.006369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925426-5228-49d5-8dfb-d9f752f721cb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:20.015036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 126/252] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:19 2022] GET /identity/v3/role_assignments?user.id=9de0f5db5d1a463a8b7a902586a0b11b&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=8977d59593e349deac60a482ae067640 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:20.069703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3000d4-d862-4238-8c59-96f3bba8fabc None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.070092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3000d4-d862-4238-8c59-96f3bba8fabc None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.070263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3000d4-d862-4238-8c59-96f3bba8fabc None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.072617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 127/253] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:20.079643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.079944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.080198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.113406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:20.114655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:20.217062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995ae98-70e2-4f22-a22b-7f7673f71ea0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:20.282021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 128/254] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:20.287474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:20.287474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.287474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.287474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/d91d597b92174c138142c4d4e0115a49/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.287830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, user_id=d91d597b92174c138142c4d4e0115a49, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:20.288750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae8a6-9ed8-4023-81cb-e0c1b7f85895 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:20.309171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 127/255] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:19 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/d91d597b92174c138142c4d4e0115a49/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:34:20.327106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:20.356821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bc93-6052-4798-a7e2-d190b8bcce64 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.357119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bc93-6052-4798-a7e2-d190b8bcce64 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.357427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bc93-6052-4798-a7e2-d190b8bcce64 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.359259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 128/256] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:20.365490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.365774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.366048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.390868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:20.392422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:20.401631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:20.496485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:20.563887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:20.583071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da526-a73d-4746-813e-723c233bca97 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:20.604542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:20.660560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:20.661392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.663056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.663340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.695493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:20.711273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:20.712255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:20.713460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 129/258] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:20.721453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:20.773300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb978e-c82e-45cf-9f14-111adc6f7e50 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:20.811765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:20.812899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:20.813544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:20.814019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:20.827167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:20.840457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:20.841473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:20.842234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:20.845164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:20.851055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:20.922960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:20.943758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee8f0-1a07-4ac4-93a9-30be182975a5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:20.990304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:21.013705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.015444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.015987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.016470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.017484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:21.018011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.020767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.035863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:21.041443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:21.115654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bfb3e-a81b-477b-998b-9fff9b609eae None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:21.157155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.158952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.160133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.160907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.162421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:21.163067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.166644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.182410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:21.191477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:21.316394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd20b-5ba2-4a6d-89fa-98657a774488 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:21.413493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.415014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.415306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.415614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.417011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.418501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.420220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 131/262] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:21.426967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:21.443307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37345b78-91e8-4dfd-9d06-ba7cff6d7bec None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:21.457218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:21.490758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:21.522955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.524330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.527194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.528989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] PATH_INFO: `/v3/users/075e1fac6be44fe38a053cb735c35d38` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.530864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] RBAC: Authorizing `identity:get_user(user_id=075e1fac6be44fe38a053cb735c35d38)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.535030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.537946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 132/263] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/users/075e1fac6be44fe38a053cb735c35d38 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:21.544608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:21.619152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddf9ea-b918-4668-bcf8-b2c4e494e058 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:21.665597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.666527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.667053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.667513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.715471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5dc9-725b-4c4b-bdaf-3ea6d87a886f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:21.753826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:21.754774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:21.755204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:21.755690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:21.765473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.767747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.799694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:21.803716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:21.831959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:21.833468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:21.891512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 132/264] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 14:34:21.899552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:21.945746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:21.951000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:22.048542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:22.072920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d279bd-b3c2-469e-bffd-fb4aa6455fd8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.097661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8344be-edd5-439e-8a06-8ea8839d93f6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.135673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:22.136942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.137458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.137928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.140385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:22.142108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:22.144310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 134/266] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:22.151408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:22.151906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:22.173721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:22.175591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.175591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.175889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.177427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:22.178916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:22.180714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 133/267] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:21 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:22.187170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:22.349811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322328d0-8f69-4ea7-8448-fda8ffca2ba0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.371474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57e86-9eb5-43aa-ac02-d54af3e3e7dc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.414769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:22.415658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.416151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.416640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.418074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=075e1fac6be44fe38a053cb735c35d38) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:22.418399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:22.419922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679b42b-4e6d-40b7-83ae-7e9bc524b41e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:22.427485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 135/268] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:22 2022] GET /identity/v3/role_assignments?user.id=075e1fac6be44fe38a053cb735c35d38&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:22.428685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85d73-ca6c-456d-8cef-c8919e355e75 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.428963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85d73-ca6c-456d-8cef-c8919e355e75 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.429243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85d73-ca6c-456d-8cef-c8919e355e75 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.430698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 136/269] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:22.436486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fea2-74d0-4667-9486-60aa60a1c253 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.436780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fea2-74d0-4667-9486-60aa60a1c253 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.437050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361fea2-74d0-4667-9486-60aa60a1c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.439873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:22.441295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.441579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.441859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.442733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=075e1fac6be44fe38a053cb735c35d38) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:22.443050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:22.444603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:22.449625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:22.458460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e361fea2-74d0-4667-9486-60aa60a1c253 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:22.459113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 134/270] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:22 2022] GET /identity/v3/role_assignments?user.id=075e1fac6be44fe38a053cb735c35d38&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=d4da261147b04e7288ffb922c442bf0e => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:22.459729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e361fea2-74d0-4667-9486-60aa60a1c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:22.548129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 137/271] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:22.573914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:22.664242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:22.735598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e606-0389-4e14-bb99-4c59fc7f1dcf None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.790281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333d59-725b-4709-99ef-f91ecdfcf881 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.790576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333d59-725b-4709-99ef-f91ecdfcf881 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.790867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:22.791587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8333d59-725b-4709-99ef-f91ecdfcf881 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.791703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.791976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.792260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.794541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:22.798320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63945e7-529e-4320-a3a6-f021f73b7f2b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:22.798320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 135/273] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:22.798747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 138/273] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:22.802138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:22.802464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:22.802707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:22.804860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8333d59-725b-4709-99ef-f91ecdfcf881 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:22.828912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:22.830372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:22.968333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 136/274] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:22.986709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8333d59-725b-4709-99ef-f91ecdfcf881 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:22.998980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.028097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.028843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.029222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.029455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.030224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:23.031803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b86fc9-ef4c-4f0f-96b8-d49a8b0317d8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:23.041846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.059248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 139/275] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:22 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:23.084441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.140074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d7b36-6c39-4d41-92ed-60a3802a7fd6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.189207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cc48-85d1-4756-be46-dcbacf46ed3d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.189452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cc48-85d1-4756-be46-dcbacf46ed3d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.189793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704cc48-85d1-4756-be46-dcbacf46ed3d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.191921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 140/276] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:23.200440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.200822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.201050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.208861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.211272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.211927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.212408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.222067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:23.223214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:23.229306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:23.242077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:23.243162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:23.244373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:23.249001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 137/277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:23.250622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.332402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 141/278] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:23.356251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.404869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66796051-a994-4c71-a004-750e1fb14569 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.431552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.458585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.459271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.459593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.459871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.460642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:23.460952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:23.462536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:23.472366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 138/279] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:23.478437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.547794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859221-33f3-4fae-9f45-8854d7dc9899 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.593073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.595005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.596271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.597074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.597555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.614513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:23.619919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ec93-fce3-4bf5-b08d-246451997008 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:23.633759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:23.634685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:23.635468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 142/280] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:23.642180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.694189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.695095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.695389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.696493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] PATH_INFO: `/v3/users/f3db2a8b7a0044bda34350ab240abfd3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.726129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] RBAC: Authorizing `identity:get_user(user_id=f3db2a8b7a0044bda34350ab240abfd3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:23.727747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:23.731790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 139/281] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/users/f3db2a8b7a0044bda34350ab240abfd3 => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:23.739040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.824699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.831799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459c81-fc1a-47dc-abdd-60f0cfa0bc56 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.872401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.873127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.873407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.873802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.874579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] RBAC: Adding query filter params (name=reader) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:23.875006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:23.876662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba554e-1679-4a3b-9ee0-f74d7397f02b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:23.887953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 143/282] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:23.889542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7613bc-5667-4fe8-886a-c8bc6346400d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.889855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7613bc-5667-4fe8-886a-c8bc6346400d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.890110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7613bc-5667-4fe8-886a-c8bc6346400d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.895609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 144/283] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:23.896637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7613bc-5667-4fe8-886a-c8bc6346400d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:23.921550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544ce8-df67-4247-91a8-9702901bfcba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:23.957362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:23.975077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:23.975859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.976267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.976553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:23.977471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, user.id=f3db2a8b7a0044bda34350ab240abfd3, scope.system=all) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:23.977852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:23.980200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f66f9-8f84-407e-bf5b-9cf57b98b964 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:23.986405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/role_assignments?user.id=f3db2a8b7a0044bda34350ab240abfd3&scope.system=all&role.id=c0d3425b913b4de780118a257ec996d2 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:23.987903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:23.988283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:23.988630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.029412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:24.031756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:24.066816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7613bc-5667-4fe8-886a-c8bc6346400d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.140277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.141580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.142025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.142520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] PATH_INFO: `/v3/users/9de0f5db5d1a463a8b7a902586a0b11b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.147871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] RBAC: Authorizing `identity:get_user(user_id=9de0f5db5d1a463a8b7a902586a0b11b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:24.147871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:24.148453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:23 2022] GET /identity/v3/users/9de0f5db5d1a463a8b7a902586a0b11b => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:24.154193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:24.183820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:24.208548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:24.264178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:24.286729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7541-8c9d-445f-aa3c-8900127380ab None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.302571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:24.327422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.328338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.328654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.328916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.330188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:24.332357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:24.334513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:24 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:24.341522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:24.389374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f23ff-7bba-4906-970c-9d347fc490d7 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.449784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.451019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.451309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.451613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.469883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:24.492306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:24.493235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:24.494012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:24.501258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:24.540371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a271b31-d864-4005-b9df-d9184e1782fb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.583625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.584549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.584835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.585114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/9de0f5db5d1a463a8b7a902586a0b11b/roles/8977d59593e349deac60a482ae067640` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.588020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, user_id=9de0f5db5d1a463a8b7a902586a0b11b, role_id=8977d59593e349deac60a482ae067640)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:24.589836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:24.615338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 147/289] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:34:24 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/users/9de0f5db5d1a463a8b7a902586a0b11b/roles/8977d59593e349deac60a482ae067640 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:34:24.674525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:24.691804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d61e5d-2c3c-4a6d-8160-00ed3e127f75 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.746853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.747605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.747896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.748177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.748978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:24.749302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:24.751620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:24.774011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 143/290] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:24.781892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:24.859736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:24.935249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5d61d-8da9-4680-9e5f-972e63a552dc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:24.978714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:24.979685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:24.980021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:24.980366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] PATH_INFO: `/v3/users/d91d597b92174c138142c4d4e0115a49` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:24.981796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] RBAC: Authorizing `identity:get_user(user_id=d91d597b92174c138142c4d4e0115a49)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:24.983266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:24.985038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 148/291] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:24 2022] GET /identity/v3/users/d91d597b92174c138142c4d4e0115a49 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:24.990772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:25.141398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e2bf-1a11-42bf-b944-a7e90c107882 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:25.185810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:25.186492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:25.186784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:25.187067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:25.222741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:25.282710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:25.284299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:25.429528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 144/292] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:25.434756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:25.590602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfaf0b-db8a-40d2-9c59-1e9a427e6b94 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:25.604021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:25.631157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:25.632055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:25.632338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:25.632613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:25.633825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:25.635289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cae07-3836-4eb2-8331-460f458f01e7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:25.637055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 149/293] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:25 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:25.644218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:25.738545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:25.812254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f136ba-5499-4a1b-a1e0-d34f04621d9e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:25.867474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:25.868162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:25.868448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:25.868731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:25.869586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=d91d597b92174c138142c4d4e0115a49) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:25.869906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:25.871352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:25.875376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c8e-fa42-41cf-9673-74edf67731af None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:25.875972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c8e-fa42-41cf-9673-74edf67731af None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:25.876438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c8e-fa42-41cf-9673-74edf67731af None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:25.878979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 150/294] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:25.884887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 145/295] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:25 2022] GET /identity/v3/role_assignments?user.id=d91d597b92174c138142c4d4e0115a49&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=c0d3425b913b4de780118a257ec996d2 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:25.885247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0c87-52f1-4482-b673-2c198c830050 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:25.885731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0c87-52f1-4482-b673-2c198c830050 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:25.886202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0c87-52f1-4482-b673-2c198c830050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:25.920183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-18de0c87-52f1-4482-b673-2c198c830050 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:25.921462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-18de0c87-52f1-4482-b673-2c198c830050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:26.031945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:26.057214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.168141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b8f-0820-4a44-9594-b0284fb1f6b5 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.168655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b8f-0820-4a44-9594-b0284fb1f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.169435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50b8f-0820-4a44-9594-b0284fb1f6b5 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.172628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 152/297] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:26.179113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.179744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.180247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.202998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:26.204736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:26.209880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468631-9851-40a5-963b-d48416134ff7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.232188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:26.264295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.266149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.266452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.266734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.286411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:26.297249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:26.298195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:26.304062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 146/298] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:26.306634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.317487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 153/299] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:26.341536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.383335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:26.444270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6b88-a037-423a-8b75-f577ba5ba688 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.463169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908467b-2f4f-4783-a79c-1fb7c2375239 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.484110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.485045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.485509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.485938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.486921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:26.487429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:26.489734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:26.498993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 147/300] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:26.502845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.503857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.504295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.504697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.505881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.506290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:26.507933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:26.514783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 154/301] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:26.515993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.555730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:26.632459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51d8d-7454-4d67-837d-6e0e652339cf None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.635431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36876-387a-46aa-90c0-55faca510fed None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.647826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:26.674145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.675234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.675692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.676203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] PATH_INFO: `/v3/groups` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.677121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:26.678895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc69283-d537-476d-b344-ffdfe2ff3f7e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:26.684196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.685133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.685553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.685849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] PATH_INFO: `/v3/users/6ddd7271c5694981ac5e14b4aee01a98` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.698266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 155/302] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Jul 20 14:34:26 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:26.704578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] RBAC: Authorizing `identity:get_user(user_id=6ddd7271c5694981ac5e14b4aee01a98)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:26.706099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:26.710923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 148/303] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/users/6ddd7271c5694981ac5e14b4aee01a98 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:26.713220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c9649-12db-43f4-a51a-eacfa95c7ec1 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.713518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c9649-12db-43f4-a51a-eacfa95c7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.713877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c9649-12db-43f4-a51a-eacfa95c7ec1 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.715355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 156/304] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:26.716419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.722646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.722959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.723186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.748416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:26.749706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:26.845685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:26.858480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 157/305] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:26.868145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab12bc-1e6e-4c8b-ab51-17d8ebda9bea None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:26.884944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:26.924220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:26.925818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:26.926106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:26.926387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:26.927296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, user.id=6ddd7271c5694981ac5e14b4aee01a98, scope.system=all) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:26.927640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:26.931118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:26.935563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 149/306] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/role_assignments?user.id=6ddd7271c5694981ac5e14b4aee01a98&scope.system=all&role.id=8977d59593e349deac60a482ae067640 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:27.022726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:27.032062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aca42-2ec7-4ff0-b5da-f94bd7e4ed0f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.081040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.082385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.082874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.083340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.096634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:27.106036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:27.107212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:27.108017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:27.110829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 158/307] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:27.117954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.246552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42b3ef-f3f4-4801-8632-bed5cff4f0f7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.288771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.289579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.289865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.290149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.291115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:27.291443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:27.292964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c9de4-905a-4582-b86d-c7262f6a4d8c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:27.303103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 150/308] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:27.310268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.333361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930bf73-1cd1-4714-a899-9c7650e34c24 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.333666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930bf73-1cd1-4714-a899-9c7650e34c24 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.333933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930bf73-1cd1-4714-a899-9c7650e34c24 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.335596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 151/309] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:27.341512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.341908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.342194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.362067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:27.363252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:27.382633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:27.449411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15189d7-af90-4764-958b-d9d82a29f136 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.452188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 152/310] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:27.469351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.492715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.494307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.494840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.495912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] PATH_INFO: `/v3/users/f3db2a8b7a0044bda34350ab240abfd3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.497717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] RBAC: Authorizing `identity:get_user(user_id=f3db2a8b7a0044bda34350ab240abfd3)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:27.500711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:27.503390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 159/311] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:27 2022] GET /identity/v3/users/f3db2a8b7a0044bda34350ab240abfd3 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:27.508606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.547062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:27.602519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765e25-7bc3-4f92-bd32-3ed557edb180 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.639263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddd22c-4302-418c-8ffa-660595cb6059 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.643665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.644840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.645328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.645799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.658732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:27.668389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:27.669326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:27.670107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:27.677917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 153/312] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:27.679517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.679836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.680662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.681041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.681361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] PATH_INFO: `/v3/system/users/f3db2a8b7a0044bda34350ab240abfd3/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.682989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f3db2a8b7a0044bda34350ab240abfd3, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:27.684499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:27.695692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 160/313] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Jul 20 14:34:27 2022] PUT /identity/v3/system/users/f3db2a8b7a0044bda34350ab240abfd3/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:34:27.705293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:27.821224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2722-2b2d-4a03-a755-b56d73b2a3ae None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:27.877346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:27.879214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:27.879521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:27.879804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:27.880591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:27.880904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:27.882421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:27.895972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:27.898913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:27.997813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:28.018401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d53bc-df8e-426c-9c97-a1e8c745a302 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:28.061703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:28.063033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:28.063623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:28.064182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] PATH_INFO: `/v3/users/9de0f5db5d1a463a8b7a902586a0b11b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:28.065989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] RBAC: Authorizing `identity:get_user(user_id=9de0f5db5d1a463a8b7a902586a0b11b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:28.067854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:28.070282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:27 2022] GET /identity/v3/users/9de0f5db5d1a463a8b7a902586a0b11b => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:28.076825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:28.184303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:28.221006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e2b8-c3b4-4561-97d3-ff4b1d2202a3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:28.262742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:28.263693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:28.264129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:28.264584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:28.340068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:28.342099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:28.424249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:28.455406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 155/316] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:28.461666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:28.592041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264297f-d427-4347-9021-9478262b3d41 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:28.629751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:28.630672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:28.630981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:28.631259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:28.632519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:28.633988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc71774-3b72-48ae-826a-0d89c46b3395 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:28.636043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 162/317] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:28 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:28.641763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:28.755546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91546db-efb9-451f-8967-146b507e3a95 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:28.794612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:28.795294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:28.795612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:28.795900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:28.796766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59, user.id=9de0f5db5d1a463a8b7a902586a0b11b) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:28.797085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:28.798561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da38ee2-0777-4ca1-bfaa-9b61d5889f1d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:28.805837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:28 2022] GET /identity/v3/role_assignments?user.id=9de0f5db5d1a463a8b7a902586a0b11b&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=8977d59593e349deac60a482ae067640 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:29.085069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bc19-083f-438e-b3f4-75ad3a995bc5 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.085243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bc19-083f-438e-b3f4-75ad3a995bc5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.085648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bc19-083f-438e-b3f4-75ad3a995bc5 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.087256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 163/319] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:29.092908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.093203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.093483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.112660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:29.113865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:29.125473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eaa3-8376-4c17-87a5-b7d0ebd8a883 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.125821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eaa3-8376-4c17-87a5-b7d0ebd8a883 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.126050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eaa3-8376-4c17-87a5-b7d0ebd8a883 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.127596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 164/320] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:29.133435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.133719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.133997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.151553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.151995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:29.153330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:29.175940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.200385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 157/321] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:29.224013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.237804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 165/322] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:29.260707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.344138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fb298-1dab-46f4-99be-29d0b5029efa None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.373791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54eed-17b1-4c05-8a59-3a401d2f0ee0 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.384661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.385494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.385762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.386042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.387280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:29.388785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:29.390469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 158/323] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:29.396542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.417013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.417936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.418219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.418493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.430867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:29.435259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:29.439885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:29.441201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:29.444763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 166/324] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:29.448905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.465961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.522674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5392e7-d526-4a86-bba7-5ba373eb1c56 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.574747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.575443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.575756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.576032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] PATH_INFO: `/v3/groups` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.576872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:29.578465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:29.588439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218c3f-dcc8-436b-bbc9-35bace758888 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.596551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 159/325] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Jul 20 14:34:29 2022] POST /identity/v3/groups => generated 226 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:34:29.631944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.632639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.632953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.633235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.634134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] RBAC: Adding query filter params (name=reader) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:29.634460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:29.636003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:29.646283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 167/326] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:29.652623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.771099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.778495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e253d-136b-469a-8e67-e9339a2763f0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.815709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.817126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.817418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.817698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] PATH_INFO: `/v3/users/6ddd7271c5694981ac5e14b4aee01a98` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:29.818916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] RBAC: Authorizing `identity:get_user(user_id=6ddd7271c5694981ac5e14b4aee01a98)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:29.820433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd1e0c-0898-450f-addc-8801167e738c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:29.822291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 160/327] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:29 2022] GET /identity/v3/users/6ddd7271c5694981ac5e14b4aee01a98 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:29.827852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:29.925237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:29.957834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7a2a-10d9-4f72-8511-1de289c839df None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:29.997172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:29.998052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:29.998338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:29.998645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] PATH_INFO: `/v3/system/users/6ddd7271c5694981ac5e14b4aee01a98/roles/8977d59593e349deac60a482ae067640` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.000802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ddd7271c5694981ac5e14b4aee01a98, role_id=8977d59593e349deac60a482ae067640)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:30.002215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6c3e3-f1ec-4334-a447-52a17b3bbfad None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:30.011755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 168/328] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Jul 20 14:34:29 2022] PUT /identity/v3/system/users/6ddd7271c5694981ac5e14b4aee01a98/roles/8977d59593e349deac60a482ae067640 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:30.028078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eabe-af03-46bf-afbe-e181ae7da866 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:30.028364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eabe-af03-46bf-afbe-e181ae7da866 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:30.028657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7eabe-af03-46bf-afbe-e181ae7da866 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.030289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 161/329] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:30.038382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:30.038716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:30.039011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.062365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:30.063682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:30.178488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 169/330] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:30.203397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7eabe-af03-46bf-afbe-e181ae7da866 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:30.337205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7eabe-af03-46bf-afbe-e181ae7da866 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:30.380052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:30.381238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:30.381820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:30.382290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.399704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:30.408357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:30.409278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:30.410738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:30.413690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 162/331] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:30.419887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:30.510427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:30.558161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330e7e-e0a6-4704-9400-1f1e00c5e5ff None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:30.601954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:30.602649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:30.602933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:30.603209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.604030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:30.604339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:30.605881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:30.616285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 170/332] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:30.622162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:30.656159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:30.750834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fc40d-35f6-4313-9c2d-294555c0ca13 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:30.810022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:30.811134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:30.815476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:30.815476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] PATH_INFO: `/v3/users/f3db2a8b7a0044bda34350ab240abfd3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:30.815476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] RBAC: Authorizing `identity:get_user(user_id=f3db2a8b7a0044bda34350ab240abfd3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:30.815476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851406a-53d5-41c8-9f25-65c153a80869 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:30.821836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 163/333] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:30 2022] GET /identity/v3/users/f3db2a8b7a0044bda34350ab240abfd3 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:30.825453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:30.960912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a386-d127-4bb8-b508-6dd803dbbdf5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:30.997429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:31.003933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:31.004627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:31.005016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:31.005455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:31.006320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] RBAC: Adding query filter params (role.id=c0d3425b913b4de780118a257ec996d2, user.id=f3db2a8b7a0044bda34350ab240abfd3, scope.system=all) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:31.006633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:31.008147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a596a-5c87-4f3f-a1e5-18f14f3c39a3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:31.022752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 171/334] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Jul 20 14:34:30 2022] GET /identity/v3/role_assignments?user.id=f3db2a8b7a0044bda34350ab240abfd3&scope.system=all&role.id=c0d3425b913b4de780118a257ec996d2 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:32.717383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1469-7e2d-426c-bd01-735ef37440f9 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:32.717951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1469-7e2d-426c-bd01-735ef37440f9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:32.718045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb1469-7e2d-426c-bd01-735ef37440f9 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:32.719663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 164/335] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:32.724860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:32.725747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:32.726207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:32.744599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdf79-db36-486f-899f-f6af920a8f02 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:32.744599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdf79-db36-486f-899f-f6af920a8f02 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:32.744599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bdf79-db36-486f-899f-f6af920a8f02 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:32.745335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 165/336] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:32.746984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:32.748338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:32.761295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:32.761662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:32.762137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:32.809551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:32.812160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:32.846510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 172/337] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:32.880813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:32.950146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:33.039427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131475b-fd2c-4246-8e1b-fbb171960dad None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.068314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.091869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.093340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.094156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.094437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.094710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.109839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:33.119042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:33.120053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 14:34:33.120874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:33.122451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 173/339] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:33.130194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.157473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.366004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2bcd0-4999-4f5b-b206-b78a060e17cd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.374132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cbed5-abf7-462c-a03c-44de3145397b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.457059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.458652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.459225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.459522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.460309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] RBAC: Adding query filter params (name=reader) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:33.460622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:33.462031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90fe6-43cf-48d7-9f66-7bef6d014aac None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:33.471499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 174/340] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:33.472747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff5f1-4f90-4bac-ae53-fee00067f392 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.473036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff5f1-4f90-4bac-ae53-fee00067f392 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.473420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ff5f1-4f90-4bac-ae53-fee00067f392 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.481909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 175/341] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:33.482821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ff5f1-4f90-4bac-ae53-fee00067f392 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.486798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.487700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.488513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.488819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.521455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2dc85274-bba3-4abf-937c-1c6e0c1d4e26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:33.529875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:33.530794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:33.531607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 167/342] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:33.540701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8f242-42fa-46b8-9b17-92290087fce8 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.540996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8f242-42fa-46b8-9b17-92290087fce8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.541281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8f242-42fa-46b8-9b17-92290087fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.551491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.572205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-23f8f242-42fa-46b8-9b17-92290087fce8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:33.573511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-23f8f242-42fa-46b8-9b17-92290087fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:33.640379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ff5f1-4f90-4bac-ae53-fee00067f392 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.662789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:33.664859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ea1d-394a-4809-bbcd-c36365756bb9 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.665145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ea1d-394a-4809-bbcd-c36365756bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.665428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9ea1d-394a-4809-bbcd-c36365756bb9 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.666737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 169/344] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:33.668094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9ea1d-394a-4809-bbcd-c36365756bb9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.686255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.689973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.691441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.691786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.692064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] PATH_INFO: `/v3/users/6ddd7271c5694981ac5e14b4aee01a98` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.693888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] RBAC: Authorizing `identity:get_user(user_id=6ddd7271c5694981ac5e14b4aee01a98)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:33.696747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d959-7fe3-4b16-bb01-60c1be53dded None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:33.701597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 176/345] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/users/6ddd7271c5694981ac5e14b4aee01a98 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:33.703849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.704418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.704838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.733006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:33.734336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:33.811567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9ea1d-394a-4809-bbcd-c36365756bb9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.813896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 177/346] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:33.815041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.854033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.854773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.855224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.855549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.857179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:33.857179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:33.858390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:33.863811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.869603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 170/347] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:33.870487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:33.937257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a02e2-c925-42fb-b87f-6cccc00611b4 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:33.965251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:33.976205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:33.977282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:33.977731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:33.978203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:33.990401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:33.992409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7698eca-76c4-47d0-bc28-588ccb173664 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:34.000046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:34.001045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:34.001850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:34.004436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 178/348] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:34.005483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.030981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.032058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.032058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.032339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.033199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] RBAC: Adding query filter params (role.id=8977d59593e349deac60a482ae067640, user.id=6ddd7271c5694981ac5e14b4aee01a98, scope.system=all) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:34.033517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.036481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.049369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 171/349] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Jul 20 14:34:33 2022] GET /identity/v3/role_assignments?user.id=6ddd7271c5694981ac5e14b4aee01a98&scope.system=all&role.id=8977d59593e349deac60a482ae067640 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:34.051355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.123681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.128400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6679e-e423-47b1-bb5e-c2ced6bd55b4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.167611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.168800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.169288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.169812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.184354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:34.193002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:34.193906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:34.194681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:34.197205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 179/350] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:34.198257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.230762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210444-9609-4182-a92c-5ef9104bb4c6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.271887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.284040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.284805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.285610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.285893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.318780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde9ffe-19de-4330-9efb-99fec5ecf9f2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.357762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.358458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.358745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.359091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.359917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:34.360280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.361746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.371658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 180/351] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:34.372637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.388817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.390495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12806d8d-0fbb-4ea3-974b-b980090b1268 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.398818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.509550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb2bb-c3ea-4d27-9446-42155cb539b0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.535110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 172/352] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:34.535253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ae954-6b5b-4e3e-8757-badfe664517d None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.536044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ae954-6b5b-4e3e-8757-badfe664517d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.536044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ae954-6b5b-4e3e-8757-badfe664517d None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.537179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 173/353] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:34.537747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ae954-6b5b-4e3e-8757-badfe664517d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.560524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.561225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.561523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.561818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.562602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:34.562921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.564357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334a107-abe9-4ead-8904-a0a6aba16c14 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.580569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 181/354] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:34.582652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.583110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.583438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.587917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.602438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:34.603709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:34.681252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 182/355] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:34.682137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.683620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ae954-6b5b-4e3e-8757-badfe664517d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.701188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.730958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.731746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.732116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.732658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.814287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1a017-2ed8-4953-aaad-021f1fc2af8b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:34.825675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.827122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.861392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:34.862111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:34.863642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:34.863949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:34.864303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:34.865645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:34.867853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:34.869724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 183/356] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:34.870515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.949782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 174/357] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:34.951801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:34.986803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.013286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b394f77-87a2-40d5-9303-21cd352a4720 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.056844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.057865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.058341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.058857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.073256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1291c-b159-4359-a008-2c2980cda04c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.107096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.113841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.114798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.115037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.115318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.128270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:35.136482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:35.137400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:35.138248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 175/358] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:35.138912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.141083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.142548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbafbc-b36f-4864-bda9-4d4da5e028a7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.258425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.271045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c8208-e26d-46d5-bc51-6ed9807d2c06 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.293465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 184/359] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:35.293465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30e60-6a11-4aeb-bf8c-383b497abfda None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.293465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30e60-6a11-4aeb-bf8c-383b497abfda None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.293465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e30e60-6a11-4aeb-bf8c-383b497abfda None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.293465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 185/360] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:35.294053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e30e60-6a11-4aeb-bf8c-383b497abfda None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.321036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.322237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.322526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.322808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.330649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.332381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.334238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 176/361] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.334867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.400122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.431248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e30e60-6a11-4aeb-bf8c-383b497abfda None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.460004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1268b-d6fc-4f28-9583-f373e6413ab3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.469062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.469963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.470247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.470518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.471941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.473953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.476015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 186/362] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.476802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.498616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.499296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.499623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.499902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.500660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:35.500967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.502322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89329320-6cb3-47e3-b743-551c7aed7136 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.510804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 177/363] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.512333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.512626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.513396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.536490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:35.538336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:35.543479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.604372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434add64-153e-432e-bc1f-fcf75c52f531 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.615373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 178/364] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:35.620176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.643933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.645721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.646066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.646408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.647704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.649166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.650924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 187/365] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.652427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.677248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.747507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67326-ce92-4ba6-9943-0ef4f9218c77 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.793247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c7455-9655-412f-98ec-225d1df098d3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.803812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.804882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.805175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.805453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.806311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=afadf6473c434e2ea1db289230249662) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:35.806628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.808111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.812842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:35.815179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 179/366] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=d4da261147b04e7288ffb922c442bf0e => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.816582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.837326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:35.839662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:35.840710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:35.841470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:35.843686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:35.845608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:35.848740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 188/367] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:35.850061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:35.974884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cbb-83d6-4a3a-84de-f6e2a05d0145 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:35.990962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.010307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68601c2-d296-42ab-bbd0-90aa91644f1e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.026457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.027124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.027415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.027734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.059647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.060846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.061329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.061803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.077616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:36.088166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:36.089178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:36.089960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:36.090567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 189/368] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:36.091523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.118718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.120342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.162516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.263766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ec9d-482c-4f37-948a-745c2022c027 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.283709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 180/369] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:36.285000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.307064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.321334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.322616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.322906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.323196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.324876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.326357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.332147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 190/370] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:36.335879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.449471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ff8f8-b594-47f3-a001-661436549bba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.478549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d3e1e-5da2-4b0b-ae1a-4a0bf958c953 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.489016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.489684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.490338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.490632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.491509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=afadf6473c434e2ea1db289230249662) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:36.491844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.493612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.494878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.499922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 181/371] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=c0d3425b913b4de780118a257ec996d2 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:36.500753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.542542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.543855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.544408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.544691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.545482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:36.545802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.547349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.558708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 191/372] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:36.559371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.607477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.642988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3fe2-e0db-4ef1-976d-47337aa64b5d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.686922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.687854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.688135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.688509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.689891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.691900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.692657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ffe3-954e-4e98-9f7e-4bb263138c45 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.694161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 182/373] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:36.695159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.751657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.754623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.755096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.755988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.757049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:36.757811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:36.760355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:36.775957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 192/374] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=c0d3425b913b4de780118a257ec996d2 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:36.775957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:36.843290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da107049-008d-4930-bf5c-694c7a835051 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:36.886077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:36.886785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:36.887067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:36.887342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:36.890755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:36.907931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:37.015588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135588e-327a-432f-ad63-2a05f52e2c27 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:37.038664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.040911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.100976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:37.101813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:37.102099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:37.102376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:37.103620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.105110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.111477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 193/375] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:37.116595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:37.161051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 183/376] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:37.166873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:37.299150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:37.334232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055dd4-2878-4dbe-915b-611f2678a550 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:37.370492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42116d7e-1173-4452-a041-a3aac55ce293 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:37.378477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:37.410943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:37.411885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:37.412592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:37.413016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:37.414188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:37.414647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.416250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.427721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 194/377] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:37 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=d4da261147b04e7288ffb922c442bf0e => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:37.455682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:37.456600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:37.457548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:37.457961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] PATH_INFO: `/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:37.459419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2c10ce8e0d4f8ab9d78c156b64a59e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.460956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.462786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 184/378] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:37 2022] GET /identity/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:37.468781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:37.594453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2778bf-344d-49e4-abd1-9ba385f830be None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:37.632705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:37.633501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:37.633786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:37.634063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] PATH_INFO: `/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:37.641458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] RBAC: Authorizing `identity:get_group(group_id=3dd2c3fcaca94d8aba0421abfbbfdb85)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.642980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91483db4-1588-4c9e-be79-8c8dc930d2e6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.645240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 195/379] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:37 2022] GET /identity/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:37.650881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:37.803359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e41f-c843-4259-98b6-f194a4b9dd90 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:37.819724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:37.850078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:37.850754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:37.851039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:37.851320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:37.852200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] RBAC: Adding query filter params (group.id=3dd2c3fcaca94d8aba0421abfbbfdb85, role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=6d2c10ce8e0d4f8ab9d78c156b64a59e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:37.852519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:37.853978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4418de-2d72-48d3-a2fb-b345f6ee1407 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:37.864069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 185/380] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:37 2022] GET /identity/v3/role_assignments?group.id=3dd2c3fcaca94d8aba0421abfbbfdb85&scope.project.id=6d2c10ce8e0d4f8ab9d78c156b64a59e&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:38.237980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d729-e34a-48f5-99ce-c890e9430f10 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:38.238542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d729-e34a-48f5-99ce-c890e9430f10 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:38.238542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d729-e34a-48f5-99ce-c890e9430f10 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:38.240421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 196/381] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:38.245956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:38.246435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:38.246518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:38.265085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:38.266284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:38.356432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 186/382] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:38.397387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d729-e34a-48f5-99ce-c890e9430f10 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:38.448053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:38.555804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d729-e34a-48f5-99ce-c890e9430f10 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:38.604694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:38.605517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:38.605799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:38.606075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:38.621567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:38.630381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:38.631269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:38.632517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 197/383] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:38.637377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:38.782523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb170e-5b42-435a-83a9-8c8e65532077 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:38.790812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:38.826098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:38.826794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:38.827082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:38.827366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:38.828172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:38.828488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:38.829877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab54b-1dbe-4d5f-959b-de70608d5231 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:38.842907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 187/384] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:38.849094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.020622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:39.024923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3330-0a1c-4fd2-bd68-e7cfe417d195 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.025470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3330-0a1c-4fd2-bd68-e7cfe417d195 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.026534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3330-0a1c-4fd2-bd68-e7cfe417d195 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.027898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 188/385] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:39.032878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319971b-1db8-4b5b-be4a-3622afc8b7d9 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.034280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.034898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.035554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.056074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:39.057611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:39.090010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.092547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.093083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.093562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.096001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:39.097915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:39.100975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 198/386] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:38 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:39.106923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.189155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 189/387] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:39.245531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3830-d945-4b01-9a24-a1ce4c96e21b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.249571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.282109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.283049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.283284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.283595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.284828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:39.286455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:39.288585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 199/388] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:39.294809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.378355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:39.402367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d2d1b-4be0-4e0a-8e10-ce00f8145396 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.410980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:39.441255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.442964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.443390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.443832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.456235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-fe8dfa11-2500-4d78-97b5-0d5088fb4b83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:39.464854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:39.465794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:39.466609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:39.469263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 190/389] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:39.470689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0991f-1ff7-4233-a073-4eb3b32c7934 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.471162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0991f-1ff7-4233-a073-4eb3b32c7934 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.471478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0991f-1ff7-4233-a073-4eb3b32c7934 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.472924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 191/390] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:39.476343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0991f-1ff7-4233-a073-4eb3b32c7934 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.515961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76629b-adf7-4581-8fda-fd7634992ef0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.564584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.565609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.565999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.566449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/groups/0d875ce1b7444353aea9256380b53eca/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.568889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, group_id=0d875ce1b7444353aea9256380b53eca, role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:39.571024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d1c4-23c6-4ce9-808f-44612b2ee298 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:39.589793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 200/391] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Jul 20 14:34:39 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/groups/0d875ce1b7444353aea9256380b53eca/roles/d4da261147b04e7288ffb922c442bf0e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:39.592937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.594364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.594794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.610143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0991f-1ff7-4233-a073-4eb3b32c7934 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.633190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:39.635386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:39.688154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.689149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.689700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.690109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.691017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:39.691542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:39.693216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:39.714420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 192/392] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:39.719818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.721497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 201/393] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:39.764573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:39.770890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.817876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:39.895767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d3357-e57e-4af1-9b91-e5efff1d0d0e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.939183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67eb5-d677-43d7-9417-ed91421f7d6a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:39.944531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.945405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.945766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.946050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.947269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:39.948748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48627f6-563e-4e9d-b761-a7d8655dc7fd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:39.951300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 193/394] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:39.956393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640046b2-60bb-4e01-8a51-3c3578729334 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.959092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640046b2-60bb-4e01-8a51-3c3578729334 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.959509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640046b2-60bb-4e01-8a51-3c3578729334 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:39.961222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 194/395] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:39.962998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640046b2-60bb-4e01-8a51-3c3578729334 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:39.992416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:39.993292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:39.993576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:39.993855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.005437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-8c235da6-9cc5-4901-b4a0-9963e5030814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:40.013625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:40.014518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:40.015299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 202/396] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:40.021851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.022141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.022423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.042394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:40.044234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:40.074626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.091040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640046b2-60bb-4e01-8a51-3c3578729334 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.137131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.138055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 203/397] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:40.139165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.143790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.145949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.146472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.152413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.154175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.156673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 195/398] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:39 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.162431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.164725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.270218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca442-7257-4c6c-a599-279de9c528a5 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.279537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae5b5c-74b1-48a7-a3dd-1b0b021bd303 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.309351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.310223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.310575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.310947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.312006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:40.312414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.314016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.318377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.319963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.320417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.320837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662/groups/0d875ce1b7444353aea9256380b53eca/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.323066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 204/399] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.327724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.328119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=afadf6473c434e2ea1db289230249662, group_id=0d875ce1b7444353aea9256380b53eca, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.331568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.351883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 196/400] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Jul 20 14:34:40 2022] PUT /identity/v3/projects/afadf6473c434e2ea1db289230249662/groups/0d875ce1b7444353aea9256380b53eca/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:40.351883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.393185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.416438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.471974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18212479-6b6a-4080-879a-6e02b2645cc6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.500252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6bc4-89ba-4606-b6ca-09eeec9b4b89 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.529203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.529203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.529203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.529203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.542471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d3209105-d89d-4c52-aa51-3aa3adb7fbcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:40.550791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:40.551735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:40.552494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:40.553076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.553174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 205/401] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:40.553241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.553241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.553241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.553640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902940e0-771d-4653-831c-20a46b57cb11 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.554088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902940e0-771d-4653-831c-20a46b57cb11 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.554501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902940e0-771d-4653-831c-20a46b57cb11 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.555822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.557355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.559165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 197/403] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.559407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 206/403] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:40.560258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.561830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.562129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.562415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.585059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:40.585059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:40.663804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 207/404] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:40.664830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.673926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.694103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144449-1ad9-43f7-a839-d38e0a1509ed None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.737707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.738762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.739285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.739760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.740654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:40.741116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.742816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.748078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.754926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 198/405] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.756090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.789562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2b47-bd34-4268-bab4-efa10ddce41f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.825088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.825962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.826265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.826546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.827807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.829267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.831058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 208/406] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.832495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.874526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e532-72fb-4091-b167-66a7f3ccf28f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.914000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.915317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.915950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.916429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.930205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:40.939040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:40.939961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:40.940874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:40.942696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ea94-a175-4f0e-b9fb-cad76e0a481a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:40.943635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 199/407] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:40.949183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:40.960453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.975339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:40.981892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:40.983316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:40.983555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:40.983966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:40.985344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:40.986972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:40.988754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 209/408] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:40.989870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.069381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055307-d67d-4aca-adce-04fafa52fc6c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.101011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43baa0-0948-4103-b2fe-982ec39a886f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.109577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.110687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.111228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.111751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/groups/0d875ce1b7444353aea9256380b53eca/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.115015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, group_id=0d875ce1b7444353aea9256380b53eca, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.116978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.136653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 200/409] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Jul 20 14:34:40 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/groups/0d875ce1b7444353aea9256380b53eca/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:41.137898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.153510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.153960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.154273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.154547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.155405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:41.155717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.157387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.176671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 210/410] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:41.182767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.231359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:41.275040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3398a1-b189-4d0a-ba68-1823bd1daff3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.307863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:41.320452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.322142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.322633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.323109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.324812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.326515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.329639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 201/411] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:41 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:41.335839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.402307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b642ecf-6113-4c25-be21-b10f0bfdc548 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.446649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.447557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.447846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.448122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] PATH_INFO: `/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.450754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] RBAC: Authorizing `identity:get_group(group_id=3dd2c3fcaca94d8aba0421abfbbfdb85)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.452440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.454415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 211/412] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:41 2022] GET /identity/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85 => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:41.462649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ddb3-1a80-4416-8c20-1607889c0775 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.464238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.499971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.500863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.501149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.501429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/groups/0d875ce1b7444353aea9256380b53eca/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.503750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc1a1f845b4cbaab058302c390fc59, group_id=0d875ce1b7444353aea9256380b53eca, role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.505258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.507718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:41.544294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 202/413] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Jul 20 14:34:41 2022] PUT /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59/groups/0d875ce1b7444353aea9256380b53eca/roles/d4da261147b04e7288ffb922c442bf0e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:41.633413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32960a59-09f7-4f84-80d4-0f19fbb9bbf4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.674333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:41.690970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.692836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.693365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.693847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] PATH_INFO: `/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.695563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] RBAC: Authorizing `identity:get_project(project_id=6d2c10ce8e0d4f8ab9d78c156b64a59e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.697762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4cf05-7d82-4827-9602-682024d8965f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.700112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 212/414] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:41 2022] GET /identity/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:41.707087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:41.852752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964c60-4ecf-4e87-97f6-0299748d7921 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:41.907424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:41.908361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:41.908644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:41.908920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] PATH_INFO: `/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e/groups/3dd2c3fcaca94d8aba0421abfbbfdb85/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:41.911616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2c10ce8e0d4f8ab9d78c156b64a59e, group_id=3dd2c3fcaca94d8aba0421abfbbfdb85, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:41.913117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc7145-da90-4769-b902-4acb1feaa14e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:41.939635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 203/415] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Jul 20 14:34:41 2022] PUT /identity/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e/groups/3dd2c3fcaca94d8aba0421abfbbfdb85/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:34:42.083382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae0eb-ece7-4954-a13e-24f23d35dba7 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.084123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae0eb-ece7-4954-a13e-24f23d35dba7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.084611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae0eb-ece7-4954-a13e-24f23d35dba7 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.087000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 213/416] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:42.093981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.094284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.094548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.118376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:42.120428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:42.195055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:42.220183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 204/417] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:42.245274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae0eb-ece7-4954-a13e-24f23d35dba7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:42.418366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae0eb-ece7-4954-a13e-24f23d35dba7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:42.471746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:42.472711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.473515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.473827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.497402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:42.506287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:42.507656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:42.508802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 214/418] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:42.513942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:42.698630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0c705-6772-4421-8ded-8f99e1215d39 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:42.754010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:42.754623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.754909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.755189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.755993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:42.756304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:42.757726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8c89-6e20-406d-933c-69d712d40685 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:42.771390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 205/419] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:42.777257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:42.794143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e6df-e3a7-46ca-b6e6-6df9f5e6d161 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.794758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e6df-e3a7-46ca-b6e6-6df9f5e6d161 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.795228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e6df-e3a7-46ca-b6e6-6df9f5e6d161 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.796864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 206/420] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:34:42.803145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:42.803763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:42.804235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:42.824753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:42.827505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:42.887826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:42.911852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:42.960657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 207/421] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:42.982173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802233-7fa2-45dd-9578-4907db8a87a6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.008804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.050344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.054544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.055061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.055530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.149129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:43.151682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:43.252431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:43.288490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 215/422] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:43.293934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.308087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a5e98-2d04-4973-91a2-a56db1c28c22 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.377773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.378846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.379735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.380019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.414962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:43.433837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:43.435095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:43.436077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:43.442895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 208/423] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:43.443867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.451182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a406e55-9ac7-40bc-b01e-cafe75cc8623 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.507369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:43.512868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.516625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.526807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.526807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.534479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:43.536570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:43.548048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 216/424] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:43.553719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.611110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13e7d-2fcf-4237-9c27-1c3c772becbd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.615889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:43.678579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.681257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.681781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.683071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.684176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] RBAC: Adding query filter params (name=member) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:43.685501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:43.687150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:43.701028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 209/425] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:43.706909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.765490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaf71-856e-41aa-990d-5aaf666981f5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.842509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.843304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.843617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.843896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.847510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:43.849929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f4011-4a14-44cb-8920-84db8f96ddba None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:43.851970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 217/426] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:43.853254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad99f-279c-4d8f-93eb-85fc02e0e183 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.853534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad99f-279c-4d8f-93eb-85fc02e0e183 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.853809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaad99f-279c-4d8f-93eb-85fc02e0e183 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.859477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 218/427] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:43.861372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaad99f-279c-4d8f-93eb-85fc02e0e183 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:43.895704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:43.902188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e07-19ce-4979-9f6c-552a7198c695 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:43.948686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:43.949904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:43.950386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:43.950889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:43.984805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:43.996449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaad99f-279c-4d8f-93eb-85fc02e0e183 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.040392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.041632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.042302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.042668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.042910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.043886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=afadf6473c434e2ea1db289230249662) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:44.044178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.044569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.045632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3128c-aaca-4a30-a6d9-699184a60e5f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.053961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 219/428] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=d4da261147b04e7288ffb922c442bf0e => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:44.055336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.055662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.056110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.079257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:44.080519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:44.170143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 220/429] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:44.193162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.196389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.199748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 210/430] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:44.209819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.297738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.317811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c50ba-ca2d-4de1-a08b-1a40f3dc91f4 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.360869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.362049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.362535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.362639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c6e5-5868-4e13-9ed9-570d74e1224c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.363131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.376478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-42865c02-b449-4cd2-acf7-c053d2052317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:44.385201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:44.386956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:44.387868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 221/431] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:44.393240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5679-69eb-49a5-9813-e4f77c79aa4c None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.393240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5679-69eb-49a5-9813-e4f77c79aa4c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.393240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b5679-69eb-49a5-9813-e4f77c79aa4c None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.394540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 222/432] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:44.400668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b5679-69eb-49a5-9813-e4f77c79aa4c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.411610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.412449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.412734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.413059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] PATH_INFO: `/v3/projects/afadf6473c434e2ea1db289230249662` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.414272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=afadf6473c434e2ea1db289230249662)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.417183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8f7c3-6a64-48ea-96b7-be011ed80ce6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.418059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 211/433] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/projects/afadf6473c434e2ea1db289230249662 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:44.424471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.424753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.424942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.449331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:44.453023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:44.537561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.545693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b5679-69eb-49a5-9813-e4f77c79aa4c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.555651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 212/434] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:44.555651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.587136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.587136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.587414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.587629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.588398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] RBAC: Adding query filter params (name=member) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:44.588769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.590133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.601487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 223/435] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:44.604411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.617984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.685474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b88821-7a38-4661-ac0b-77379c2baa1d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.723433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5af6-6668-4d04-9301-a7306ae36dfa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.725671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.729179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.729551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.729843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.732504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.734250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.736135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 213/436] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:44.736849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.766243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.767056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.767336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.767639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.778370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-a02c034f-a4e7-4aa5-971e-11607cbc2f33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:44.787176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:44.788362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 224/437] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:44.789871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c81-508c-4d39-a61a-335bc5888a90 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.792078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c81-508c-4d39-a61a-335bc5888a90 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.792078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6c81-508c-4d39-a61a-335bc5888a90 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.792078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 225/438] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:44.792977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6c81-508c-4d39-a61a-335bc5888a90 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:44.816363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.856426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cbbf-e8a1-4dce-84a8-22083f91c30a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.868573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:44.895181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.895921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.896212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.896495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.912450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6c81-508c-4d39-a61a-335bc5888a90 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:44.958744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:44.959306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.959620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.959897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.960743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=afadf6473c434e2ea1db289230249662) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:44.961058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.962514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51938a4-4fbe-4822-8c79-f933be061c24 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:44.969310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 226/439] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=afadf6473c434e2ea1db289230249662&role.id=c0d3425b913b4de780118a257ec996d2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:44.970872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:44.971010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:44.971283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:44.975042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:44.976614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.008212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:45.009447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:45.066719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.105663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 227/440] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:45.106375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.122747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 214/441] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:45.128809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.204615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.265681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449899d-5b8c-414c-9bc4-e753cbb400dc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.279963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f851ae-901f-4f31-81a4-e7785e0faca0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.308800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.309490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.309773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.310045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.310821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:45.311132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.312600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.322237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 228/442] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:45.323444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.327338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.328264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.328557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.328840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.330143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.331657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.333957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 215/443] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:45.334770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.389266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.483026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00596827-47f1-49af-8719-4433d3a5bc4e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.506133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96189a27-8d2d-4b36-8e53-165014133519 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.522302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.537523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.538498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.538819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.539097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.554308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:45.562916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:45.564517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 229/444] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:45.565715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.572817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.573482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.573764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.574041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.663431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.664929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.693974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895af7d-cb23-4ca3-87c6-93a6f6407b5b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.696054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.737010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.737879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.738165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.738493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.740679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.742272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.744003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 230/445] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:45.744780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.778400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 216/446] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:45.779188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.802503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.858960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec138e9-4c35-4b46-bdd3-c38897842781 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.888192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d733-08e4-44a2-92fc-2e7699a98f7a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:45.895255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.896491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.896781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.897063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.898201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:45.898529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.900435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.909386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 231/447] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:45.910148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:45.920134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:45.925800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:45.927036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:45.927323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:45.927650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:45.928524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=c0d3425b913b4de780118a257ec996d2, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:45.928841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:45.930348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:45.936865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 217/448] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=c0d3425b913b4de780118a257ec996d2 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:45.937712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.046168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172220-7e7a-4866-ab1c-7d3450bb455b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.062504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439df71f-e280-474e-b802-d29e28d2445a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.069534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:46.095099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.096000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.096288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.096568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] PATH_INFO: `/v3/projects/5fdc1a1f845b4cbaab058302c390fc59` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.097955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] RBAC: Authorizing `identity:get_project(project_id=5fdc1a1f845b4cbaab058302c390fc59)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.100448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.101797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 232/449] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/projects/5fdc1a1f845b4cbaab058302c390fc59 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:46.107569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.110001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.110670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.110959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.111230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.197550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:46.206785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.209076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.245139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8260d-5cb5-46e4-9287-f53313ea7923 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.296704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.297829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.298121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.298407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] PATH_INFO: `/v3/groups/0d875ce1b7444353aea9256380b53eca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.299732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] RBAC: Authorizing `identity:get_group(group_id=0d875ce1b7444353aea9256380b53eca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.301789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.307522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 233/450] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:46 2022] GET /identity/v3/groups/0d875ce1b7444353aea9256380b53eca => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:46.310181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.346784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 218/451] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:46.352571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.377259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:46.437288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd92864-e7f6-40fa-a436-063411280be8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.457571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:46.463973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b8028-cd75-47f1-b956-bbbdff6ef2da None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.481216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.481897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.482180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.482455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.483331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] RBAC: Adding query filter params (group.id=0d875ce1b7444353aea9256380b53eca, role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=5fdc1a1f845b4cbaab058302c390fc59) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:46.484004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.485465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.492780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 234/452] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:46 2022] GET /identity/v3/role_assignments?group.id=0d875ce1b7444353aea9256380b53eca&scope.project.id=5fdc1a1f845b4cbaab058302c390fc59&role.id=d4da261147b04e7288ffb922c442bf0e => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:46.500919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.501818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.502106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.502383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] PATH_INFO: `/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.503719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2c10ce8e0d4f8ab9d78c156b64a59e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.505442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.507308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 219/453] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:34:46 2022] GET /identity/v3/projects/6d2c10ce8e0d4f8ab9d78c156b64a59e => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:34:46.513376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.641245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08798-0cbc-4928-bb73-157103cdddbe None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.660147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:46.683535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.684417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.684746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.685065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] PATH_INFO: `/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.686333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] RBAC: Authorizing `identity:get_group(group_id=3dd2c3fcaca94d8aba0421abfbbfdb85)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.687885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100f8de-314e-424b-9c9c-c67c9eec3885 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.689565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 235/454] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Jul 20 14:34:46 2022] GET /identity/v3/groups/3dd2c3fcaca94d8aba0421abfbbfdb85 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:46.695848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:46.814323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1aa8-9337-4855-9718-294ff7037036 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:46.855698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:46.856375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:46.856660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:46.856942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:46.857799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] RBAC: Adding query filter params (group.id=3dd2c3fcaca94d8aba0421abfbbfdb85, role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=6d2c10ce8e0d4f8ab9d78c156b64a59e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:46.858115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:46.859848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bb617-d55f-4c25-8664-aa27dee57743 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:46.866935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 220/455] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Jul 20 14:34:46 2022] GET /identity/v3/role_assignments?group.id=3dd2c3fcaca94d8aba0421abfbbfdb85&scope.project.id=6d2c10ce8e0d4f8ab9d78c156b64a59e&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:49.427294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938deb-5240-4a2c-a132-4401c034a627 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:49.428474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938deb-5240-4a2c-a132-4401c034a627 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:49.428989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938deb-5240-4a2c-a132-4401c034a627 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:49.430936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 236/456] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:49.437142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2767f-f727-4c13-8054-94ffd5c25a04 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:49.437648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2767f-f727-4c13-8054-94ffd5c25a04 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:49.437722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2767f-f727-4c13-8054-94ffd5c25a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:49.460416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8cc2767f-f727-4c13-8054-94ffd5c25a04 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:49.462840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8cc2767f-f727-4c13-8054-94ffd5c25a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:49.493400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:49.565903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 221/457] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:49.603480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938deb-5240-4a2c-a132-4401c034a627 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:49.761227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938deb-5240-4a2c-a132-4401c034a627 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:49.814314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae660d9-ea06-4746-9763-b612661510ac None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:49.814632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae660d9-ea06-4746-9763-b612661510ac None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:49.814730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:49.814937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae660d9-ea06-4746-9763-b612661510ac None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:49.815419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:49.815729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:49.816007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:49.816304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 222/458] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:49.828816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:49.829507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:49.829988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:49.834014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:49.834014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:49.862045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:49.863145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:49.864635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:49.864635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:49.864635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:49.864635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:49.870942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:49.872379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:49.876996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 237/459] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:49.888421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:49.974747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:49.977822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 223/460] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:50.015733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.041989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206c6f1-09d5-4351-a273-b77ce36f06ef None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.092867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.093897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.094327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.094868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.095806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:50.096288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.097851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661afd85-6c64-4b6c-95ca-53d021736f0b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.119202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 238/461] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:50.120916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724dad-89a9-479c-8013-b330acd9ee4a None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.121357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724dad-89a9-479c-8013-b330acd9ee4a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.121811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724dad-89a9-479c-8013-b330acd9ee4a None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.127486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 239/462] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:50.127486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79724dad-89a9-479c-8013-b330acd9ee4a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.142995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:50.158414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593f2ae-9469-4ce3-b10c-99342b46da88 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.200450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.201527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.201818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.202267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.214250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.215760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-99a8c87a-a6aa-46b3-8741-7be2d67fd98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:50.235126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:50.236088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:50.236925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:50.236925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:50.236925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.236925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:50.236925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 224/463] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:50.238260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0685-bd37-4fa3-b7b4-bead25ade03e None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.238552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0685-bd37-4fa3-b7b4-bead25ade03e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.238874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0685-bd37-4fa3-b7b4-bead25ade03e None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.240549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 225/464] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:50.241602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce48f-fe65-4113-b1d7-c91659ce79cb None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.241903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce48f-fe65-4113-b1d7-c91659ce79cb None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.242181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce48f-fe65-4113-b1d7-c91659ce79cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.242605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:50.253912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79724dad-89a9-479c-8013-b330acd9ee4a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.261376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-73fce48f-fe65-4113-b1d7-c91659ce79cb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:50.262714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-73fce48f-fe65-4113-b1d7-c91659ce79cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:50.299829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.300503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.300796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.301074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.302583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.304089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.339640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 240/465] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:50 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:50.339640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.355150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 226/466] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:50.356586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.356875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.357154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.386138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:50.387381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:50.480399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:50.491706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 227/467] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:50.493058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.540326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53d33-1bfc-4e87-a2f3-6bb01b39dcdc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.604213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.605506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.605793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.606360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.607122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:50.607737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.610479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.625798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 241/468] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:50.626889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.641359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:50.646994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037d30-2f24-4695-a200-059b660c00ac None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.691643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.693220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.693586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.693866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.705138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.706664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:50.729912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:50.730811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:50.731669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:50.731669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:50.731669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.731669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:50.735593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 228/469] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:50.739540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.789117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a172-3638-4e51-b4e1-0e1aaeff077f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.827888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:50.844728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.845783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.846204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.847280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.864488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.866480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.883855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7d2d-9cd6-4e75-a878-a3b9f40b2f96 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:50.891679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:50.892647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:50.893564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:50.893564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:50.893564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:50.893564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:50.899485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 242/470] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:50.899485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.941167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:50.942673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:50.943098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:50.943564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:50.944448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:50.946805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:50.980291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 229/471] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:50 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:50.981397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:50.990397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:51.078427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c92e-0d8f-4387-b1da-45ec8bc4e60a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.143023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177fc7f-b38f-4eb9-8f3c-42ef360ccd65 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.156750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:51.166955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.167846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.168214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.168637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.172334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:51.173400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:51.175039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:51.190734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.191717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.193111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.193650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.194567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:51.195022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:51.196628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a91e74-8e56-4b58-8645-91804d0853b3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:51.207999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 243/472] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:51.213452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 230/473] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:51.213629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:51.220009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76004e9-d8be-41a6-86c2-e4515a994c86 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.220605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76004e9-d8be-41a6-86c2-e4515a994c86 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.222073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76004e9-d8be-41a6-86c2-e4515a994c86 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.224667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 231/474] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:51.225645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76004e9-d8be-41a6-86c2-e4515a994c86 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:51.359374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5089f-cccb-4de2-b8a4-621e5ff38227 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.379865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76004e9-d8be-41a6-86c2-e4515a994c86 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.387659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:51.407805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.408854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.409361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.409863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.411674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:51.417626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b016a-7f7d-4a81-860f-2f952525b621 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:51.427634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.428707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.429196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.429694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.431955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:51.432735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:51.449665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 244/475] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:51 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:34:51.451604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.452219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.452776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.458768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 232/476] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:51 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:51.474892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:51.476685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:51.567735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 245/477] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:51.596786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:51.642936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:51.746653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0877-9560-4334-aa3c-fc63b27b095a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.789936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.790635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.790925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.791213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:51.792045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:51.793453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:51.803554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.sql.core [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 14:34:51.803554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 14:34:51.803554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [parameters: {'id': 'b60d7dae14b84206997b9187357fd96e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 14:34:51.803554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application result.read() Jul 20 14:34:51.820930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:34:51.821874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application yield resource Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise self.value Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application session.commit() Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 14:34:51.823043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self.session.flush() Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application compat.raise_( Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 14:34:51.823983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:34:51.825023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application result.read() Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:34:51.825944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [parameters: {'id': 'b60d7dae14b84206997b9187357fd96e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:51.826852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 14:34:51.831882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:51.833311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 233/478] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Jul 20 14:34:51 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:51.833484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:51.949119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188548-70e7-4be4-9940-667c37b5e1db None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:51.959832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:51.987803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:51.989263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:51.989522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:51.989862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:52.002300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-60f741a2-4c1a-4219-8667-b85ad53d0c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:52.011363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:52.013473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:52.015362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 246/479] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:34:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:52.019472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:52.146402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:52.165144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e633ce-34f8-4c8d-ab8d-2461f578883b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:52.219642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:52.220340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:52.220688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:52.220953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:52.221773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:52.222086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:52.224058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae8ed-4c3d-4741-9bdc-878523481b1c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:52.239629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 234/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:53.132074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2246db-e495-4936-8aa9-48c5e5bd583b None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.132829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2246db-e495-4936-8aa9-48c5e5bd583b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.132829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2246db-e495-4936-8aa9-48c5e5bd583b None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.134357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 247/481] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:53.139901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.140509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.140509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.164755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:53.166006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:53.256843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 235/482] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:53.296501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2246db-e495-4936-8aa9-48c5e5bd583b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:53.464549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2246db-e495-4936-8aa9-48c5e5bd583b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:53.526250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:53.526250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.526250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.526250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.544506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-b20351cb-1b34-4f15-a4f4-1b907608c9d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:53.553351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:53.554255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:53.555045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:53.556152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 248/483] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:53.561274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:53.690193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:53.717325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb73d-9b87-42b2-b774-175a90b42a8c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:53.770446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:53.771290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.771535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.771730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.772508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:53.772821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:53.774222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:53.788252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 236/484] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:53.791952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0185bb-b5c1-4ac5-af5c-a73d6f605c3e None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.792246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0185bb-b5c1-4ac5-af5c-a73d6f605c3e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.792534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0185bb-b5c1-4ac5-af5c-a73d6f605c3e None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.794214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 249/485] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:53.795279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:53.801188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:53.802069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:53.802317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:53.835518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:53.837906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:53.903216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:53.978829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 250/486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:53.985568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5281-ccca-4cca-9f9a-35d0fc165cae None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.015355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.043886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.045019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.045395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.047941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.070885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:54.072420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:54.076325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:54.106343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:54.107289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:54.108244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:54.108244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:54.108244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:54.108244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:54.108244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 237/487] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:54.124858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.222027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0652-25e2-4c3d-803a-402815800fca None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.262939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.264263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.264554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.264836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.279793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-6ab49aa8-f0e0-4fdd-b33b-d30f5694c717 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:54.289792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:54.290940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:54.291923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 251/488] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:54.299487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a75b1-2839-424a-87dd-e876194e478c None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.299487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a75b1-2839-424a-87dd-e876194e478c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.299487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a75b1-2839-424a-87dd-e876194e478c None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.299487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 252/489] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:54.299487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a75b1-2839-424a-87dd-e876194e478c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.316827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a811670-78c9-4e4b-b7ec-34e5036dc077 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.322856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.363424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.364650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.365184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.365802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.366631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:54.367029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:54.368551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66c23-82ed-4581-b057-ca2cc71731e2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:54.386306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 238/490] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:54.386306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.386306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.386306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.405340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:54.406639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:54.433260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a75b1-2839-424a-87dd-e876194e478c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.482282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.482519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.483082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.483438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.483872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.485166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:54.485487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:54.487024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586a197-a0cc-4bb6-865b-82a7b615986a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:54.498538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 253/491] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:54.499918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20563e1-95cf-4746-a0f6-16a2e96b563f None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.500211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20563e1-95cf-4746-a0f6-16a2e96b563f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.500494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20563e1-95cf-4746-a0f6-16a2e96b563f None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.506303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 254/492] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:54.506842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20563e1-95cf-4746-a0f6-16a2e96b563f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.520108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 239/493] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:54.521513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.616403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.646451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20563e1-95cf-4746-a0f6-16a2e96b563f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.651283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b042486-01f1-4d20-99bf-d28f91fb939f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.684799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.685598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.685878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.686152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.694430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.695238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.695543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.695837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.698086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:54.699701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:54.707601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:54.709913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-4390767e-6faf-4c3c-a74f-33d9a05a25c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:34:54.716554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:54.717505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:34:54.718421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:54.722457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 255/494] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:54.723792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.724063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.724338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:54.731793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:54.732730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 240/495] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:54.740134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.745126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:54.746349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:54.783339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.836098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 256/496] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:54.837222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.871950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212359e-fd89-4775-a31f-7caf6138030c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:54.918142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:54.919590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:54.919979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:54.920471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:54.935796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:54.938161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:54.944962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:54.946021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:54.946870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 241/497] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:54.947552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:54.982196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2b094-883c-4a9c-b310-2929001e406b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.028606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.029294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.029570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.029840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.030702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:55.031013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.032562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.059828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.068536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3521ac7-3098-47c4-9eff-f788ec63554f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.076269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 257/498] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:55.077240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.111303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.112007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.112286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.112562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.113310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:55.113618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.115563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.127883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 242/499] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:55.128754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.225914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb615fa-a2db-4c19-991f-6a67fcae74f2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.258438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.268453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.269369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.269738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.270100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.270865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642501-459e-48ec-9978-1fec8550a11f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.282301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-cb689d31-9550-4c6f-b0a1-cb78ed646907 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:55.291019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:55.292133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:55.292976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 258/500] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:55.293709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a66aa-c381-42a4-a48a-105b95b461b4 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.293951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a66aa-c381-42a4-a48a-105b95b461b4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.294196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a66aa-c381-42a4-a48a-105b95b461b4 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.295717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 259/501] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:55.296322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a66aa-c381-42a4-a48a-105b95b461b4 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.321617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.322205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.322476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.322753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.323543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:55.323852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.325311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.333902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 243/502] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:55.335564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.356072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.415042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a66aa-c381-42a4-a48a-105b95b461b4 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.442886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869a33a-d14c-4f98-90ce-4534ba16a8aa None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.451149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.451845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.452121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.452396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.478800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.479743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.480024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.480309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.489751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.491120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:34:55.507494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:55.508727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 244/503] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:55.509690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.520872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.538073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.539706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ca5a-c1e4-438b-927c-1ee26a5f2496 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.615573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.640806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88ade-f5c4-4a1f-8efe-4166d2ab366d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.652012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 260/504] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:55.653254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145111dc-c484-4421-9922-df65bc728c78 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.653540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145111dc-c484-4421-9922-df65bc728c78 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.653818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145111dc-c484-4421-9922-df65bc728c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.672532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-145111dc-c484-4421-9922-df65bc728c78 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:55.673749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-145111dc-c484-4421-9922-df65bc728c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:55.681374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.682186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.682497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.682761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.683564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:55.683880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.685274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.693919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 245/505] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:55.694820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.749298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 261/506] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:34:55.750196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145111dc-c484-4421-9922-df65bc728c78 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.775400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.806253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ed3f-617b-4eb4-9ee8-a557161e0ea9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.845943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.846743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.847024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.847301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.858351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:55.858542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145111dc-c484-4421-9922-df65bc728c78 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:55.861089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.862663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:55.883545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:55.884589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 246/507] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:55.885615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.902940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:55.903684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:55.903960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:55.904233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:55.905118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:55.905428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:55.906887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:55.925740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 262/508] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:55.926642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:55.993423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4e90-d066-4ef9-bfd8-e93e31ac8dd3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.021989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.029365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.030178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.030463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.030738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.042752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.044269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.052287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecbf5c-e569-47bc-8d2f-4cc43d41ba5e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:56.062956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:56.064184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:56.065025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:56.065025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:56.065025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.065025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:56.065025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 247/509] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:56.065395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.106057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.106863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.107150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.107427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.115385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.118964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.120486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:56.139481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:56.140649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:56.141597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:56.141597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:56.141597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.141597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:56.141597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 263/510] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:56.141909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.183382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bef2-c4f8-48f5-ac98-3f699a7a5762 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.218547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.219352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.219669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.219949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.231093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.232558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.251496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a9bc-2c3f-4095-9bef-89de6b933b5f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:56.252136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:56.253516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:56.255129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:56.255129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:56.255129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:56.255129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:56.255129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 248/511] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:56.255723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.288327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.297360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.299723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.299723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.299723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.299723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:56.300311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.302681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.319254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 264/512] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:56.320170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.356396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.364931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80368-27bd-4897-a9d3-cb76360b66e6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.402255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.402830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.403121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.403406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.440194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fe20-6a34-48c7-aa47-1537bab940ce None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.481334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.482205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.482346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.482346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.482583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.483290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:56.483488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.483657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.485270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.498612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 265/513] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:56.499615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.560470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.596351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.608058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 249/514] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:56.609005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.625455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027fd6-696b-44fa-8aeb-49577a19cfb6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.660921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.662115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.662400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.662686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.663432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:56.663774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.665183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.686048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 266/515] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:56.686048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.736059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a1ba0-081e-4629-8640-6b1ce314bdd6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.772296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.774797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.774797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.774797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.774797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:56.774797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.776011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.788478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 250/516] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:56.789324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.796700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d7fe-92c7-4e97-81c5-ce5a1cd55543 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.806915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.832680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.833696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.833971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.834243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.844399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.845856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.850830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:34:56.863812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:56.865544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 267/517] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:56.866749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:56.909859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e088d-f181-41b1-a8e1-6a41852290e4 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:56.951841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:56.952713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:56.953032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:56.953316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:56.962205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:56.963618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:34:56.979684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:56.980768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:56.981795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 251/518] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:56.986689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.006832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ada02-2cb2-44a0-8180-fb2466bfaacc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.049215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.050022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.050303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.050579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.062127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.063647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:57.081889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:57.083215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 268/519] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:57.084379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.101227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd4f0-a31d-4b2a-ab1b-454130256b26 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.116646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.123378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.143687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.144588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.144771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.145050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.156618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.158379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:34:57.175577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:57.176684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:57.178070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 252/520] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:34:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:57.178821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.215292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83d21-f1e9-41e8-ba04-b3b12623a39f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.252277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.253255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.253255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.253581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.254290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.256029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.280508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 269/521] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:34:57 2022] POST /identity/v3/users => generated 247 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:34:57.281569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.300972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7cff7-915a-4923-a458-653b413b8328 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.341802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.342513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.342805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.343086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.344027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:57.344344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.345877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.380677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.394456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 253/522] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:57.394456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.422021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbfb0f-ca05-4039-958f-90c9e962a3a0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.434316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.475068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.475728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.476021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.476301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.477120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:57.477440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.478932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.501912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 270/523] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:57.503146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.522137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbc1d-f5b1-484c-b0e1-814deeefc1d9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.562869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.563608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.563900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.564183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.564925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:57.565238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.566700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.588867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 254/524] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:57.588867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.636814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41332573-ce07-47e1-8012-77adcf300b8c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.677312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.677999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.678287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.678564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.679435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:57.679778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.681285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.690350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.712225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:57.713669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 271/525] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:57.714517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.727497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663e711-06a9-4d6b-bbfc-c452f212361a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.769028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.769689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.769987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.770340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.838117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32d0b-13e0-4d0b-92a3-75c8b5ce1ac7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:57.859265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.861037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.881641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:57.882615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:57.882899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:57.883173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:57.884303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:57.884687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:57.886698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:57.902234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 272/526] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:57.902234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:57.979919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.007952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.017911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 255/527] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:58.019013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.024056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f378ba1-6213-4ed7-8d59-fd88cb43cb9e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.070169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.071063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.071349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.071656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.080288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.081783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:34:58.101119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:58.102104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 273/528] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:58.102933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.151429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff53ef-79e6-4e13-be2c-8adce8e58cf6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.202182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.203125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.203417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.204237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.228816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac74a8-fdf2-46da-a48a-09793eef2d27 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.249550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.270895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.271761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.272046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.272362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.285689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.290520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.291790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.301132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.303132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:58.314578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:58.315799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:58.316686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:58.316686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:58.316686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:58.316686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:58.321657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 274/529] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:58.322665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.424600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 256/530] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:34:58.426382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.443181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08db0-dc2d-4297-8717-539b8b3a3653 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.485065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.485857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.486145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.486423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.487248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:58.487597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.489111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.503985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 275/531] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:58.505726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.543728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.553535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf949-3ad7-4bd1-b395-392d9b19f444 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.554198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.596088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.597131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.597686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.598185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.599716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:58.600372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.602116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.616629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 257/532] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:58.617839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.645284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973dd9a-1717-483a-9caa-e7ac7e424629 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.684977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.686452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.686979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.687386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.700105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.701666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:34:58.728972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:58.729880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:58.730715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:34:58.730715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:34:58.730715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:34:58.730715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:58.735146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 276/533] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:58.736121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.737543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e161-31d9-41d5-9937-2d293e63b178 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.776546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.777545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.778107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.778708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.779817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=dae0c98ee06544579ca6cdbe1163a028) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:58.780365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.782013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.789846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 258/534] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/role_assignments?user.id=dae0c98ee06544579ca6cdbe1163a028&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:58.791052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.815025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.837724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:58.858763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83214-a700-4a9c-99d1-e41133f348cb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.899627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.900459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.900734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.901014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.909406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.911165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:34:58.929101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:58.930038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:58.930886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 277/535] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:34:58.932075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf483e-93b8-41c2-80b9-09950dfc73a7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:58.936779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:58.972542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:58.973733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:58.974330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:58.974855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:58.975942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:58.976619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:58.978490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:58.993491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 259/536] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:59.011615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.067974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed58e4-ab74-4d3a-ba98-0d14d1e8ea33 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:59.109460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:59.110454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.110734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.111063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.112098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:59.112418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:59.114025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:59.131685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 278/537] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:59.134833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.137912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:59.157472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:59.188729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ca8c-3644-4b83-be93-43dfde5d8a9c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:59.243079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:59.244667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.245852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.246354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.258778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:59.260704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:34:59.287719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:59.288626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:34:59.289498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:34:59.291877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 260/538] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:59.298179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.325519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f9d15-63e5-4f30-8475-412d3f26da9c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:59.367225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:59.368295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.368809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.369290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.370451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=64bc77e79518405f8915783e7fee812b) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:59.370988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:59.372801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e91dbc-eb6c-4ba4-a1d0-8e6a225b8820 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:59.381161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 279/539] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/role_assignments?user.id=64bc77e79518405f8915783e7fee812b&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:59.499488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eff5c-3a99-4e59-8af8-da4ad5c36cc6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:59.534754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c04dc-14b7-4883-84f4-421b32de5f72 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.535052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c04dc-14b7-4883-84f4-421b32de5f72 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.535325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c04dc-14b7-4883-84f4-421b32de5f72 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.537735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 280/540] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:34:59.549794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.549794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.549794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.584372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:34:59.585629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:34:59.596307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:59.597073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.597073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.597073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.598624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:34:59.598940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:34:59.600905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:34:59.625042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:59.637937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 261/541] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:34:59.648168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.715070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:34:59.724883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 281/542] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:34:59.750127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.866157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0e567-0f6d-404c-ab2f-5eb6fdccc359 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:34:59.907073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:34:59.907908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:34:59.908190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:34:59.908663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:34:59.921709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:34:59.935903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:34:59.936975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:34:59.937791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:34:59.940423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 282/543] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:34:59.946808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:34:59.981553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8565a9-a222-45f8-8684-452005f03786 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:00.044784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:00.110252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:00.110938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.111225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.111542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.113845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed02256-b99f-4c3e-8e0b-35c9a361d8c8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:00.116910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=9fc7a82e40184ae28526ca41ddca25d3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:00.117218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:00.119025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:00.132937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 262/544] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/role_assignments?user.id=9fc7a82e40184ae28526ca41ddca25d3&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:00.172559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:00.173379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.173785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.174078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.174905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:00.175221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:00.177543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:00.194884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 283/545] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:00.203479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:00.306891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:00.361396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6c39d-60fc-407d-a395-06300ed97b78 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:00.402647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:00.403393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.403720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.404006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.417966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:00.419556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-06b2dcc0-cebc-46ad-9532-246e4274cafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:00.445508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:00.447702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:00.449947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:00.449947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:00.449947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:00.449947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:00.449947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 263/546] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:00.457543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:00.581049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e1e9-7862-43e0-a1c9-cd4e37b8dda8 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.581567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e1e9-7862-43e0-a1c9-cd4e37b8dda8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.581978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e1e9-7862-43e0-a1c9-cd4e37b8dda8 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.593060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 264/547] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:00.602452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.602900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.603341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.621151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90066-1803-4f5f-bf84-2440c2233d27 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:00.639703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:00.655577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:00.656769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:00.675817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:00.676595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.677531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.677818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.678609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:00.678926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:00.680644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:00.702262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 284/548] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:00.709182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:00.806449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 265/549] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:00.829044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:00.870931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16142247-b943-4db4-ae7f-6acb046df2aa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:00.929471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:00.933822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:00.934361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:00.934805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] PATH_INFO: `/v3/users/swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:00.948190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:00.949789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:00.951488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:00.969754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:00.971324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:00.972999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 285/550] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:00.980989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:01.060758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:01.076952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52650-17a8-4dcd-8a43-a732374eed2c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:01.147433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:01.148272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.148556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.148831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.172438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:01.180948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:01.181878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:01.183071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 266/551] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:01.188495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:01.194889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a30a5-1e3a-4171-8c91-e97d20a1a62a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:01.240314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:01.241404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.241890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.242364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.243439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:01.244231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:01.247042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:01.299634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 286/552] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:01.302146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:01.479826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5963-a43a-477c-9739-2245eaa75ece None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:01.488609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:01.503854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:01.511831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70407-8e07-4e80-8eca-ca1e55b87789 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:01.569986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:01.571065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:01.571754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.572036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.572311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.573248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.573535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.573810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.574589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:01.574900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:01.576340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:01.594397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 267/553] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:01.603011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:01.705694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:01.707420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f5b52-4704-4756-935a-0462e3a21d24 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:01.804600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ef467-6a64-4586-bc94-c4c0b2bba5cf None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:01.839184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:01.852266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 287/554] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:01.855959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def23e-161e-4b93-a94a-26fc10c8825a None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.855959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def23e-161e-4b93-a94a-26fc10c8825a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.855959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def23e-161e-4b93-a94a-26fc10c8825a None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.857756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 288/555] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:01.857756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def23e-161e-4b93-a94a-26fc10c8825a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:01.866338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:01.867442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.868037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.868319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.880711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:01.882183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d41ae841-fce6-4bb6-b19d-2086e0aac97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:01.902085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:01.903033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:01.903934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:01.903934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:01.903934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:01.903934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:01.908259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 268/556] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:01.909786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:01.910083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:01.910370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:01.929019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:01.930331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:01.945408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:01.982723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def23e-161e-4b93-a94a-26fc10c8825a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.015478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 269/557] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:02.015478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.045146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.046100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.046467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.046751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.063248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.065171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:02.088962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:02.090380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 289/558] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:02.091642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.152204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4b62-d18a-40df-a672-313eec0591ef None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.156815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.189347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.190021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.190313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.190603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.191345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:02.191690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.193621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.211398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 270/559] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:02.211398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.217714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4e70b-a277-4bbf-8e2c-b7db0fc9a655 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.221783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.253597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.254411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.254691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.255513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.268151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-a59dc11b-7508-49a2-992c-860ccb7f5968 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:02.276496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:02.277415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:02.278326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 290/560] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:02.279012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715494a-5159-46dc-ae6d-226cb186e4f3 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.279412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715494a-5159-46dc-ae6d-226cb186e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.279544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715494a-5159-46dc-ae6d-226cb186e4f3 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.280911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 291/561] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:02.285414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715494a-5159-46dc-ae6d-226cb186e4f3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.338257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044bd6-620c-4c2d-b3f2-e403ea0171c5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.407852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.408733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.409017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.409297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.410050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:02.410359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.411927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.431956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 271/562] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:02.431956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.449466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715494a-5159-46dc-ae6d-226cb186e4f3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.461215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.491939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729369-bcbd-4424-9393-3f915983672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.492952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729369-bcbd-4424-9393-3f915983672d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.493292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729369-bcbd-4424-9393-3f915983672d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.493615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729369-bcbd-4424-9393-3f915983672d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.503192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729369-bcbd-4424-9393-3f915983672d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.504750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729369-bcbd-4424-9393-3f915983672d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.521218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-69729369-bcbd-4424-9393-3f915983672d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:02.527232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:02.528498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:02.529474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:02.531837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 292/563] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:02.533388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.533904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.534401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.554106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:02.555735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:02.567292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d5002-f14e-4043-b745-65ea843f8d66 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.616383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.617524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.617862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.618281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.619214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:02.619702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.621261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.640789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 272/564] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:02.640789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.664991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 293/565] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:02.665834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.766547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4191a-8093-4ded-9a5f-b9f8f2e47623 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.783535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.788331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6dd8-dd59-4ea3-bbdd-b59ab8afd81b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.796145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:02.803322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.804157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.804441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.804715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.816670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.819359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.824763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:02.825602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:02.825887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:02.826165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:02.827030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:02.827344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:02.828841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:02.845509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:02.846603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:02.847541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:02.847992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 294/566] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:02.848293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 273/567] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:02.849770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.849989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:02.964858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ab816-58df-49cd-aaab-4ab16b2153d0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:02.977262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5743-54c8-45bd-9948-7953024a79b2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.001673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.002474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.002761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.003039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.013481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.015022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-9cc4d342-b6e3-4cdd-8c5d-3c64cb3bbae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:03.032981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:03.033993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:03.035123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:03.035123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:03.035123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:03.035123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:03.035547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.035647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 295/568] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:03.035719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.035719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.035852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c4b1-8aab-4ffd-b469-4c17d25a0a82 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.035931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.036005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c4b1-8aab-4ffd-b469-4c17d25a0a82 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.036863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c4b1-8aab-4ffd-b469-4c17d25a0a82 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.038594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 296/569] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:03.040358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c4b1-8aab-4ffd-b469-4c17d25a0a82 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.051617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.055995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:03.070685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:03.071715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:03.072530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:03.073190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 274/570] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:03.074227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.132358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.151150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c4b1-8aab-4ffd-b469-4c17d25a0a82 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.184820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6e91-9716-4280-9969-24e3afd89f36 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.187418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.188252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.188537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.188811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.199439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.200920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:03.219739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:03.220689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:03.221654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:03.221654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:03.221654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:03.221654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:03.221867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.221867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.222051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 297/571] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:03.222186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.222186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.222327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.222395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:03.222998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.224543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16011-b90e-48bc-949e-bef9b1dfe019 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.237297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 275/572] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:03.238586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.238877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.239156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.255607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:03.256813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:03.285952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.327476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 276/573] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:03.328261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.337918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040183-645b-48b3-b6ad-d10ba4bc22a4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.371839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.376131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.376799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.377080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.377354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.378085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:03.378391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.379782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.391360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 298/574] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:03.392215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.433181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569702aa-3a70-454b-aef3-70e79fc3a04c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.470817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.471415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.471742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.472029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.472799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:03.473116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.475054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.484718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 277/575] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:03.485849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.499978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd2fe-73ff-443b-8a4d-52b5c6a80575 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.522413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.541344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.542119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.542394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.542666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.543403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:03.543748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.545112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.557235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 299/576] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:03.558075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.609395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c0e47-cd1b-411b-906b-de6695556122 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.610428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.647188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.647892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.648160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.648439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.649286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=a52d17454c264a51a14b1d6a7786b570) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:03.649603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.651048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.657045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 278/577] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/role_assignments?user.id=a52d17454c264a51a14b1d6a7786b570&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:03.657570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.664241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd5b65-6b9e-4e7f-b419-4b546329ce83 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.723774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.724509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.724875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.725210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.745663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:03.759562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:03.760607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:03.761445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:03.762087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 300/578] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:03.763061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.817424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eb012-c6a7-405e-a194-5be46e9c1caa None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.832025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.867645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.868844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.869127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.869404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:03.879093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:03.881590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:03.900360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:03.901512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 279/579] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:03.902564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:03.935100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808828de-6fab-445a-9981-26cd41ca1f27 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:03.945351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:03.981394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:03.982118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:03.982427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:03.982680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.001529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.002327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:04.023779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:04.025272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 301/580] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:04.026705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.044504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be4fb9-ed40-4a9b-8dc4-97903cfec1e1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.112239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.113461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.113899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.114319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.125268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.127648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:04.151057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:04.152321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:04.153568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:04.159434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 280/581] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:04.160269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.174464 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.187640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb7bf-41ff-4c02-b7a2-d5d9a6255ad8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.229178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.230270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.230556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.230836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.231690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:04.231981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.233418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.245694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 302/582] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:04.246731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.292509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.311107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b6b19-75e6-49ff-b15a-b7b458d99ffa None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.351273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.351977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.352262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.352537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.353390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:04.354264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.355226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.376698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 281/583] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:04.383976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.394815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a0501-93eb-4359-ad33-2340774b5eb3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.442068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.443203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.443553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.443907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.444751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:04.445120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.446784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.466746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 303/584] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:04.467658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.486432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.534007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dd11-66a5-4860-b697-3e51ff2fb367 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.585613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.586339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.586648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.586954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.587832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:04.588155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.589609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.611476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 282/585] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:04.612230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a460c-b063-4f7c-b17a-fa21c1f75bf5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.612987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.619749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.660968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.663024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.663486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.663932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.678738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.680359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:04.699928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:04.700912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:04.702037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:04.702037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:04.702037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.702037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:04.703918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 304/586] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:04.705275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.756809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c605f-96a4-4b80-9cb6-1081b8b206ba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.784872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.814614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.815776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.816398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.816878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.832229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.832599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426144af-b5f0-43c8-b926-3dc98682c0d2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:04.833789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:04.853860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:04.855979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 283/587] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:04.857751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.885250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:04.886056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:04.886338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:04.886618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:04.895015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:04.899708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:04.913015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:04.914264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 305/588] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:04.915324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:04.944674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:04.998006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140803d2-dc9d-4610-bb26-be4024b39ba8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.039012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.040815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.041688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.042162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.043328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082776f8-a21a-4934-9edb-2e6610af8cda None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.064487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=54774acef6c54a06a81facfe13173568, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.067059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.071568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.081325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.081993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.082277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.082552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.084040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.084360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.085748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.090095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 284/589] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:04 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:05.091190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.103964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 306/590] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:05.103964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.249510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a10fc3-0f69-45de-aeca-8dfab397c6a9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.253629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b34181-e8c3-444e-9190-262f783d625f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.262594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.296661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.297785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.298423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.298735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.300452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.300622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.300858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.301234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.301616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.301791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.302316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.302672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.305702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.305702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.329016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 285/591] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:05.329959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.338177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 307/592] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:05.341094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.407750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.483182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc8d95-0951-4db3-94ca-eabbda7527ef None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.491657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4940-c10d-4c1b-99cd-5d8d061dd46c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.538189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.538640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.538978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.539263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] PATH_INFO: `/v3/users/glance` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.550339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.551857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.557436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.558555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.559058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.559617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:05.569746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:05.570749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 286/593] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:05.572878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.578748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.580616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.606611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:05.609050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:05.609995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:05.611188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:05.611188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:05.611188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:05.611188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:05.618266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 308/594] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:05.618266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.696093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7725-58b1-435b-be96-1f24e81594ce None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.735433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.737048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.737576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.738086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.747228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.750509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.752999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.754504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d9a6-e28a-4ba1-bbfd-014116bc2c1f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:05.774403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:05.775807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:05.776886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:05.779505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 287/595] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:05.780680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.797375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.797978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.798369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.798753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.799873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.800302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.802665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.824393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 309/596] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:05.825433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.900127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:05.917336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0fbf-e919-43e1-ba8a-9240a42a64ad None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.942412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723263c0-b392-4cc9-83c1-1acf0569aa54 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:05.954474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.955158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.955504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.955794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.956560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.956853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.958308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:05.971439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 288/597] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:05.972323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:05.987283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:05.987999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:05.988274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:05.988554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:05.989364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:05.989714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:05.991175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bf4de-6f08-4326-ae24-c7344ea1b4eb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.003804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 310/598] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:06.005722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393701-b9f7-4182-ade5-3401ec614252 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.006019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393701-b9f7-4182-ade5-3401ec614252 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.006290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393701-b9f7-4182-ade5-3401ec614252 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.011613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 311/599] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:06.011613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393701-b9f7-4182-ade5-3401ec614252 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.030028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.101400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d93d8-1286-4435-b898-88165f50ca4d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.135026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393701-b9f7-4182-ade5-3401ec614252 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.148565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.149680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.150162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.150713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.164711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.166136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.172380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.173187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.173317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.173461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.173735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.182895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.184522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:06.187047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:06.187932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:06.188794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:06.188794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:06.188794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:06.188794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:06.193609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 289/600] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:06.194428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-29b59ee8-3dbc-4ae4-851a-24a57e99ed84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:06.204155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:06.205049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:06.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:06.210567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 312/601] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:06.211997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.212295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.212577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.233848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:06.236120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:06.321208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8111523-7215-4b34-9575-202ad1921e79 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.324868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 313/602] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:06.325242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.329921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.372540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.373503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.373892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.374272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/dae0c98ee06544579ca6cdbe1163a028/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.391107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=dae0c98ee06544579ca6cdbe1163a028, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.392975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.419491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 290/603] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:06 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/dae0c98ee06544579ca6cdbe1163a028/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:06.419491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.460720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8118bf0-6b3a-4f00-80c5-9a0757f9b0ce None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.482490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.525099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.525815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.526097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.526372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.530130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:06.530453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.532004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.557727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 314/604] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:06.557727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.588993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24d959-4d3b-42b7-9d26-b2f7ab752b46 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.654020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.654985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.655807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.656380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.658635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:06.658635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.660744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.667002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.685359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 291/605] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:06.685359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.724763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acdb2c-da4d-48c5-a92d-58dfb7f4777e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.778769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.780161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.780454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.780740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.806903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:06.818443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:06.819484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:06.820326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:06.820972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 315/606] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:06.821936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:06.841109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318b7f-5483-4fa7-b03f-1628ad745ba2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:06.856559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:06.904271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:06.905456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:06.906027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:06.906544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:06.918432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:06.920462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:06.949342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:06.951114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:06.953400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:06.959585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 292/607] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:06.961455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.017793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a6e7-2f1c-495d-95f0-c6f9af71d491 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.053653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.068346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.069901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.069901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.070213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/64bc77e79518405f8915783e7fee812b/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.088604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=64bc77e79518405f8915783e7fee812b, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.090311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.117894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 316/608] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:06 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/64bc77e79518405f8915783e7fee812b/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:07.117894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.128164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4c533-bc45-494d-b7b4-a5318816f437 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.201173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.202265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.202596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.202891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.204139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:07.204139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.205593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.225808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 293/609] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:07.229517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.322418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.374340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfc82a-90a5-4e84-88b0-55cd98320b51 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.419234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.419958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.420245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.420517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.421337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:07.421639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.423085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8fc92-fa2c-4d22-acb0-d4c3a72c419f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.434704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467d0a-e1c7-4dce-a5c2-ccbb72c5c13e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.436646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 317/610] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:07.438088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946abcf9-7475-422e-8302-b0dd7fd18ad2 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.438376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946abcf9-7475-422e-8302-b0dd7fd18ad2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.438640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946abcf9-7475-422e-8302-b0dd7fd18ad2 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.447408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 318/611] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:07.447408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946abcf9-7475-422e-8302-b0dd7fd18ad2 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.480702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.481840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.482365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.482800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.487052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.499491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.501351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-e5b3d0a8-7adb-4fd4-9613-db6d93b0d8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:07.523566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:07.524681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:07.525674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:07.525674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:07.525674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:07.525674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:07.534127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 294/612] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:07.535647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a008-0973-424e-897d-890f9aedbced None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.536524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a008-0973-424e-897d-890f9aedbced None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.536524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a008-0973-424e-897d-890f9aedbced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.558740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6889a008-0973-424e-897d-890f9aedbced None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:07.560180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6889a008-0973-424e-897d-890f9aedbced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:07.574145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946abcf9-7475-422e-8302-b0dd7fd18ad2 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.621431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.622369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.622735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.623024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/9fc7a82e40184ae28526ca41ddca25d3/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.641469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=9fc7a82e40184ae28526ca41ddca25d3, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.642993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.667614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 319/614] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:07 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/9fc7a82e40184ae28526ca41ddca25d3/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:35:07.669399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.673675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 295/614] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:07.694457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889a008-0973-424e-897d-890f9aedbced None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.713315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.820943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889a008-0973-424e-897d-890f9aedbced None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.863889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.865212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.866408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.866408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.866693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.879302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:07.888435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:07.889455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:07.890712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 296/615] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:07.895760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:07.911376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb5603-d058-410c-bb61-087dc9f78efb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:07.960767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:07.961873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:07.962359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:07.962854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:07.963961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:07.964552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:07.966242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:07.975583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:07.986851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 320/616] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:07.988498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.009573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75654b38-9e81-477d-993e-1a88c7cd9938 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.072108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.073211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.074678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.075360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.077425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:08.078166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.080383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.090386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 297/617] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:08.096296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.213592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74fa7-4209-4c23-8426-451f62e04f8e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.219864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15815-20b4-4832-8fa3-619823119a62 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.266452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.267834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.268357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.268834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.271997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:08.282499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.284315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:08.303728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:08.304658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:08.305546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:08.305546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:08.305546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:08.305546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:08.308415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 298/618] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:08.313383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.373149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.373892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.374178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.374453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.404402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.406192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.431150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf9cba-5d1d-4b53-8465-33a5632e446c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:08.439691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:08.440841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:08.441981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:08.452345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 321/619] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:08.469033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.481947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.482686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:08.484401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.484958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.485733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.487571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:08.488147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.490364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.506407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 299/620] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:08.512513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.621435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b10a-b13a-40da-814a-8c92b91f84a4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.656184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:08.707175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.707912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.708173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.708495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.709680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:08.710007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.712983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.751720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 322/621] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:08.761519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.801007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb0c4-3dff-4ebe-99f0-3c0bfa29fbb8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.877991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:08.879122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.879962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.880761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.881049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.897205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.898666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:08.915517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca4eb0-b240-4d89-8e6c-368df20e563d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-9022d484-d416-45ee-a156-89fe9c364254 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:08.920289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:08.921436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:08.922480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:08.924812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 300/622] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:08.931112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddccb6-a834-463c-b3db-03cb446611a2 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.932023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddccb6-a834-463c-b3db-03cb446611a2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.932488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddccb6-a834-463c-b3db-03cb446611a2 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.934564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 301/623] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:08.935596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddccb6-a834-463c-b3db-03cb446611a2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:08.956120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:08.957031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:08.957315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:08.957591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:08.969864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:08.971330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-eb33576f-c777-40c2-a3ec-cba0c536398b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:09.011627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:09.012586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:09.013467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:09.013467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:09.013467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:09.013467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:09.014645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 323/624] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:09.017043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.017555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.018119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.046430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:09.047841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:09.061482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddccb6-a834-463c-b3db-03cb446611a2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.069733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.100929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.101645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.102050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.102339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.103224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:09.103639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.105144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.125137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 302/625] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:09.126080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.134133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 324/626] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:09.135336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.187585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.251531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d33b1-78fe-4d1c-b336-0ba9953a9e18 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.260861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf2f9-203e-4944-95f6-e3031a8f36eb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.290662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.291324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.291655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.291929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.298160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.298840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.299127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.299410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.300291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:09.300603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.302010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.320141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 303/627] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:09.321118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.347766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.388118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.390904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.432550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c696427-82dc-4910-891f-3b59975c1862 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.443759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.469279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.470378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.470667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.470948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.485399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:09.496189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:09.498176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:09.499551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 304/628] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:09.503790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.514426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 325/629] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:09.515441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.628348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.649617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bceee1-963a-4cfd-9d4d-0a4782aafc28 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.668348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ceee5-c21a-4037-90d1-ce1b82bfa85c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.702762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.703508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.703799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.704232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.711962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.713449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.724804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.725927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.726394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.726863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:09.728137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:09.728972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:09.729846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:09.730275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:09.730275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.731363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e822e-17f7-4397-b679-96711e719581 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.734112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 305/630] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:09.735003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.748651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 326/631] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:09.751213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60387-2f23-4872-8704-0eafac6f8432 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.751733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60387-2f23-4872-8704-0eafac6f8432 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.752318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60387-2f23-4872-8704-0eafac6f8432 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.754744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 327/632] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:09.756621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc60387-2f23-4872-8704-0eafac6f8432 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.776094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.857552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f164f-6f77-4c61-ab30-ef97dd5dac6b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.900051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc60387-2f23-4872-8704-0eafac6f8432 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:09.903661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.904616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.904905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.905109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.924141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.925593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.930333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:09.947886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:09.948286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:09.949145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:09.950033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:09.950033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:09.950033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:09.950033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:09.950776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.950776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.950776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.950776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:09.950776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:09.951662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98912-1be1-4fec-9be0-229130409504 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:09.954011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 306/633] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:09.954840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:09.965631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 328/634] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:09.967183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:09.967707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:09.968152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:09.986372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:09.987945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:10.056572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.066462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 329/635] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:10.068733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.081946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d021e1-81a2-44f0-880e-0e90a2915d17 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.120929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.121741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.122030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.122313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.134082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.135589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:10.156793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:10.158318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 307/636] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:10.159418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.182830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccd3a8-6901-47ee-8108-c3a21b102328 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.214748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.223405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.224207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.224496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.224964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.225893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:10.226212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.227654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ba596-901f-4f33-9fe2-528b261f3a26 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.242195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 330/637] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:10.243401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314aafa-de5c-4e64-bccb-5e9ffe7553bf None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.243680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314aafa-de5c-4e64-bccb-5e9ffe7553bf None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.243967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314aafa-de5c-4e64-bccb-5e9ffe7553bf None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.247493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 331/638] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:10.247493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314aafa-de5c-4e64-bccb-5e9ffe7553bf None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.274679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b32c-26b3-4058-a1de-c8947e373cda None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.310498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.311392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.311712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.311997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/a52d17454c264a51a14b1d6a7786b570/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.326796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=a52d17454c264a51a14b1d6a7786b570, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.328296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.331010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.341374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 308/639] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:10 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/a52d17454c264a51a14b1d6a7786b570/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:10.342209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.392958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314aafa-de5c-4e64-bccb-5e9ffe7553bf None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.433679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.434484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.434767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.435151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.449622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:10.459306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:10.461305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 332/640] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:10.462710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.472628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.478227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf214e-4257-485d-8f53-e205df6b2c5e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.542721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.543417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.543737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.544017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.544775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:10.545093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.546476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ccdb0-3c7f-407d-920e-b2688f56db99 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.559578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 309/641] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:10.560890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.561183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.561466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.579698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:10.580911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:10.592037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1c35b-e500-422e-9492-52dd389b0d35 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.611263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.631888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.633037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.633550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.634030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.641861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.643604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.657125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 310/642] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:10.657994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:10.658991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:10.659930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:10.660817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:10.663416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 333/643] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:10.664428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.775441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.783792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cf900-7184-48a0-bdd4-4b546c4c5659 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.793074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9afff-a7c7-448e-a13d-abf034275fc5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:10.827525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.827525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.827525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.827525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.832713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:10.834007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:10.834298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:10.834581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:10.835442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:10.835811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.837256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.845161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:10.846321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 311/644] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:10.847174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.848637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:10.866804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:10.867886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:10.869156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:10.873001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 334/645] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:10.873876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:10.920872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:10.973505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc535db0-ce9f-4295-8bac-ee19855a7f45 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.002753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5b833-98e5-4260-8bb2-82745bd0a507 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.021632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.022409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.022774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.023061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.023907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:11.024228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.025746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.043502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 312/646] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:11.043502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.059518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.060337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.060632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.060901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.061169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.074065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:11.081911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:11.082880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:11.084502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 335/647] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:11.085926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.172613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a191e-58bc-4b04-90d7-31dd2237c88f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.204531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.210224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.211044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.211287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdf29b-b3e2-4bb0-8b34-ed338e4e333b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.211399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.211634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.222562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.224059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:11.246019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:11.246936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 313/648] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:11.248325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.253356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.254043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.254355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.254637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.256038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:11.256360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.257797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.281743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 336/649] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:11.282543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.317377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.361055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4ecbb-954d-4a91-98d4-a1cbcb07e571 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.392599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c39490-1387-4c13-bb33-28f3c845e98a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.398798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.399742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.400240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.400703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.401748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:11.402254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.403912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.419857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 314/650] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:11.420984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.450865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.452241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.452765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.453270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.454586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:11.455180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.457580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.472542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 337/651] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:11.474337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.510745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.553581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb74bc5-7942-48d3-9874-cc1e930e3415 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.592949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.594008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.594501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.594991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.595989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:11.596527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.598545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.612961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 315/652] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:11.614369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.620208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.685314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568c6df-1a96-4da9-b910-ece88d1529f4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.741041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.741724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.742011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.744208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.758663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f93e5-8743-4d6e-974e-27a44d97414d None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:11.807833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:11.808566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:11.808853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:11.809130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:11.821992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.823502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.834851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:11.836970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:11.842646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:11.843761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 316/653] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:11.845018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.865756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.889537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:11.969753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 338/654] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:11.969753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:11.981607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd2ef-695e-4072-b20e-dfebcbe45688 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.023118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.024240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.024678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.025104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.033364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.035109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:12.051789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:12.053579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 14:35:12.054515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:12.061776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 317/655] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:12.062997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.081958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19f47-1f48-4290-a39a-15a067a9b711 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.100569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.122958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.123926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.124281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.124620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.125924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:12.126364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.128323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.145972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 339/656] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:12.147061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.174843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.181254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8814f-31ef-4e0c-b9eb-5355af3b6d6a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.219785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.220897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.221365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.221863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.234305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.236431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:12.257599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:12.258548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:12.259415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:12.259415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:12.259415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:12.259415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:12.261748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 318/657] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:12.263073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.289108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce020f-4ca6-479c-98b2-d6d339356d01 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.339102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.339918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.340199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.340472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.341369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:12.341678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.343757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.375351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 340/658] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:12.375351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.398939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2acb19-7c8e-4752-9522-c5d89660d7a9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.423798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.443596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.444691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.444984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.445264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] PATH_INFO: `/v3/users/glance` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.456218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.457986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:12.477928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:12.478957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 319/659] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:12.480571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.494626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.512989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05a805-3aec-42cb-953c-c6c369dec8cd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.565561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.566491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.566837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.567167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.568021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:12.568346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.569831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d1471-734f-4e2b-a4d4-37be198b61d8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.584650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 341/660] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:12.585698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5564a4-3c13-447d-9136-6d71f66bead5 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.586131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5564a4-3c13-447d-9136-6d71f66bead5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.586632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5564a4-3c13-447d-9136-6d71f66bead5 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.591817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 342/661] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:12.592707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5564a4-3c13-447d-9136-6d71f66bead5 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.620428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ac1c-ea3f-4cc4-87d8-3170b515085b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.660188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.660955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.661314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.662308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.717200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.730373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5564a4-3c13-447d-9136-6d71f66bead5 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.752556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.754093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e074-2672-456b-9806-896cc8e54aa6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.766610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:12.776725 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.777414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.777699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.778013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.778879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:12.779188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.780700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:12.800793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 343/662] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:12.801662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.883091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 320/663] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:12.884684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.884978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.885260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.904064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:12.905296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:12.933054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805de08b-b4e8-445b-a6a0-6edac257110e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:12.984177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:12.985006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:12.985294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:12.985572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:12.991231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 321/664] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:12.992838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:12.997680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:12.999491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:13.018459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:13.019396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:13.020346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:13.024055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 344/665] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:13.024662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.043386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.070464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.165199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5602665-f4e8-44b9-a86a-fd4722f46ca5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.176546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5ae49-916b-4828-abdc-7ccc401b1f2e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.209791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.210880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.211355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.211805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.218946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.219811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.220098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.220375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.233807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.235264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:13.254114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:13.255060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:13.256034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:13.256034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:13.256034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:13.256034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:13.256034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 345/666] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:13.256807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.296686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.298200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.343430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.356176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.398980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e431e1-7c90-42cd-a53d-b2e258a34e74 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.430448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 322/667] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:13.431634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.443627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.444451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.444740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.445037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.456093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:13.464516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:13.465456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:13.466284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 346/668] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:13.467787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.570375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb8bf6-4d11-463e-9636-cff2d34d59fe None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.602207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81720c35-6404-4dcb-8c30-623f8c4507db None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.607716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.608597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.609028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.609569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.610371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:13.610684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.612528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.622266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.631491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 323/669] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:13.631662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.631743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.644019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.644927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.645214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.645486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.646727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:13.647041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.648451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.664924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 347/670] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:13.666037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.740665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd943d22-8ac5-46ea-8f67-a2de7fe76041 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.769142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0c503-6de9-448f-b6d6-243e98b6d405 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.775041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.775880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.776166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.776835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.791158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.792676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.806627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.807306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.807625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.807909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.808670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:13.808981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.810354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:13.810931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:13.811784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:13.812636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:13.812636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:13.812636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:13.812636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:13.812636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 324/671] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:13.813510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.830950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 348/672] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:13.830950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.874973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.877285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:13.923241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f3c7c-dbd0-4375-870b-98719d5f568c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.934091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34104f6f-317b-4e56-a412-4df03ee6a060 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:13.958685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.959344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.959671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.959950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.960805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=dae0c98ee06544579ca6cdbe1163a028) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:13.961124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.962581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:13.968401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 325/673] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/role_assignments?user.id=dae0c98ee06544579ca6cdbe1163a028&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:13.969188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:13.980382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:13.981720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:13.982033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:13.982733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:13.992847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:13.994269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:14.010627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:14.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:14.012598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 349/674] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:14.013072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.092497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1f32-04d8-4d9f-99aa-3c53f0afb0dd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.110615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.132593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.133167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.133461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.133756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.134493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:14.134807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.135949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e8db-a27a-4a3f-97f8-7d54cbd6cc70 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.136276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202362c8-56b7-471c-b34e-b3ce4f6faa21 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.146461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.149778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 326/675] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:14.151619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021350-0a2f-4925-ad72-7a0a8b184fa3 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.151916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021350-0a2f-4925-ad72-7a0a8b184fa3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.152196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021350-0a2f-4925-ad72-7a0a8b184fa3 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.153967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 327/676] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:14.154753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021350-0a2f-4925-ad72-7a0a8b184fa3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.183975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.184779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.185063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.185328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.198978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.200480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d443a2a8-eed9-40ab-a843-f743faef5b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:14.219049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:14.220040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:14.220914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:14.220914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:14.220914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:14.220914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:14.220914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 350/677] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:14.221905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.221905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.222108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.240561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:14.241837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:14.278524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021350-0a2f-4925-ad72-7a0a8b184fa3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.313152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 351/678] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:14.314117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.325601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.326584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.327609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.328123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.329917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:14.330443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.332978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.348035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 328/679] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:14.349149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.386990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.417534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.446111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45798525-fc74-4e7e-8a10-ac344743178a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.484506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151be14-0984-4529-8d37-38309bd6542c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.484705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.485483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.485772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.486307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.494017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.495515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:14.511342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:14.512452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:14.513386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 352/680] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:14.513876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.536899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.537678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.538058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.538432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.539287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:14.539734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.541198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.558484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 329/681] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:14.558484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.628916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c886bd-5e47-45c4-aaf2-3483b5422390 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.653845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.661529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2544-b39f-4e50-b1fa-c00aeef58fe2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.667633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.668657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.669086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.669504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.683883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:14.691935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:14.693045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:14.694642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:14.696728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 353/682] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:14.697680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.711304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:14.717700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.718370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.718658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.718944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.719839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=64bc77e79518405f8915783e7fee812b) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:14.720162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.721628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.736242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 330/683] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/role_assignments?user.id=64bc77e79518405f8915783e7fee812b&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:14.736242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.843306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9858a-6213-4982-9540-4420a6e26eef None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.885022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.885803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.886152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.886505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.887410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:14.887830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.889361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.896379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531686-99c3-404e-88cf-f9d1739fcfdc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:14.903212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 354/684] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:14.904183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.943879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:14.945002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:14.945474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:14.945835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:14.957175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:14.958781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:14.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:14.975959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:14.976926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 331/685] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:14.977499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:14.995751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.011276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.049316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cbb6-cbb0-4d7c-9772-6982ab8a8349 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.098550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.100292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.100785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.101296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.102869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:15.103653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.105869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.108553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2810e90-fbdf-4d88-bdf0-3baf55bde440 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.120609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 355/686] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:15.121482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.153255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.154110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.154612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.154966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.156089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=9fc7a82e40184ae28526ca41ddca25d3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:15.156416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.158053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.165478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 332/687] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:14 2022] GET /identity/v3/role_assignments?user.id=9fc7a82e40184ae28526ca41ddca25d3&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:15.166817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.312398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572190-909f-493c-883f-7cced0dde141 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.345617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.354087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.354729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.355134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.355421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.356312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:15.356631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.357610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.359113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.380740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 356/688] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:15.382100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7d9e-dbd4-408e-9b7c-bc0074ed6d34 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.386311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.424081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.424916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.425204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.425482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.436966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.438437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:15.457621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:15.459877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:15.462647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:15.462647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:15.462647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:15.462647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:15.464037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 333/689] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:15.467507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.500031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cb6e-eef8-419c-8bab-bd9ce64a4ab9 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.541397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.542069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.542354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.542631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.572799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b1154-ac44-4859-9085-f0de2145cf74 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.607202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.609425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.610143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.610562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.610852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.611897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:15.612212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.613588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.616329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.624253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.625701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.627626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 334/690] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:15.633615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.741048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 357/691] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 14:35:15.742157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756357b-45b9-47c0-8460-bda369b7dcba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.746309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.780294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.781116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.781404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.781690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.789429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.790928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:15.806782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:15.807887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:15.808825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 335/692] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:15.814334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.849260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.864916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff50241-c631-46c8-bfc2-987af2d9f998 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.876404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:15.905476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.906585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.907061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.907515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.920734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.922511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:15.923828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7218-d216-4a0d-8ae7-a6c79c9d49a8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:15.943115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:15.944242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:15.945116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:15.945116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:15.945116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:15.945116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:15.947265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 358/693] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:15.960477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:15.975587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:15.977142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:15.977439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:15.977724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:15.978585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:15.978902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:15.980423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.014589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 336/694] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:16.022185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.135051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf234f2-6c6c-4e6e-ad54-bf765fe420df None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.178659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.179714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.180202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.180678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.181670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:16.182180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.183778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.194506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:16.200585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 359/695] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:16.205704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.276994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c72d-613e-4ceb-bf9c-29372d676160 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.312789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:16.340965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5dbc0-1f2e-431e-94a7-32b337629b97 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.350770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.351789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.352855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.353641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.379830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.381234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.381587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.381968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.392389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.394568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-fb6e13e4-5353-48b6-94b8-97f34fd833d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:16.416109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:16.417156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:16.418110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 360/696] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:16.419894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520e98-9cbd-4175-80d7-925d27a43815 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.419894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520e98-9cbd-4175-80d7-925d27a43815 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.419894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520e98-9cbd-4175-80d7-925d27a43815 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.426663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 361/697] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:16.426663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520e98-9cbd-4175-80d7-925d27a43815 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.450312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.452718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd349670-1604-47bc-94ad-dbe4eec08c00 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.520163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:16.572927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 337/698] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:16.574495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.574907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.575295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.582602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520e98-9cbd-4175-80d7-925d27a43815 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.592898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:16.594218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:16.604437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:16.631427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.632405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.633100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.634406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.635440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:16.635935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.637597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.655168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 362/699] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:16.656513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.675796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 338/700] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:16.675796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.803435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31cd77-aac8-4ec9-a895-5a4b0849daa9 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.808287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea4106-ca92-4382-b956-2cbd059a190c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:16.824694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:16.842551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.843294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.843664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.843947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.856360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.857830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.861842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:16.862798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:16.863279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:16.863775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:16.865425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=a52d17454c264a51a14b1d6a7786b570) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:16.866074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:16.868554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:16.875149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 339/701] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/role_assignments?user.id=a52d17454c264a51a14b1d6a7786b570&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:16.876256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:16.876640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:16.877479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:16.878410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:16.878410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:16.878410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:16.878410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:16.878410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 363/702] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:16.883856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:16.892916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.005810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceff74-bd23-465c-9add-0396bc38e74c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.025417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956b0c6-8cbb-469b-9511-3bcaaa93bd84 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.081612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.086682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.087209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.087664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.088533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.090109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.117754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.118471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.118752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.119034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.119802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:17.120110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:17.120581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:17.121497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:17.122363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.123222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.130527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 340/703] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:17.137470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.152661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 364/704] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:17.158811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.200116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.225273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.268882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d248-56f7-4200-aeee-fee981e79404 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.291198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813e6a-7ea8-4499-8512-eb343b962de1 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.315267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.317117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.317562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.317983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.319883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:17.320477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.322278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d1bf0-d7d1-487d-8627-01c1a1ddba1f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.327698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.328485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 341/705] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:17.329944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fdcd6-626b-41a8-bcea-b2b30d15e40d None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.330371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fdcd6-626b-41a8-bcea-b2b30d15e40d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.330828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fdcd6-626b-41a8-bcea-b2b30d15e40d None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.332474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 342/706] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:17.332759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.333102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.333398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.336302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fdcd6-626b-41a8-bcea-b2b30d15e40d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.343042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.344550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-cb06b9c8-6b04-4313-8704-42d0cf2c63c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:17.361083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:17.362286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:17.363176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 365/707] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:17.364241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.364536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.364816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.383408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:17.384271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:17.477385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 366/708] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:17.478681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.485544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fdcd6-626b-41a8-bcea-b2b30d15e40d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.520102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.546694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.547813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.548813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.549352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.550889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:17.551582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.553748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.558974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.565294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 343/709] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:17.566364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.659153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc77e6-b9d7-45f6-8c06-73919efbb909 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.700227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.701211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.701694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.702140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.703121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:17.703632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.705272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.718995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 367/710] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:17.725587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.774639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5e68-0614-4775-bdf7-1d9dd399aecc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.832118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.833949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.834887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.835508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] PATH_INFO: `/v3/services/network` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.836433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.839178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.855415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:17.857882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:17.859163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:17.860183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:17.864240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 344/711] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:17.870383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:17.884712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e114cf-3bf0-42e2-a234-4b0999f1a84f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:17.921634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:17.922653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.923132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.923723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.924767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:17.925281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:17.927043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a70be-3127-4636-8da0-9d0ee2700b91 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:17.934187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 368/712] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:17.952007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2a259-88b8-47b9-90eb-a8eee0afc021 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.952637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2a259-88b8-47b9-90eb-a8eee0afc021 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.953214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2a259-88b8-47b9-90eb-a8eee0afc021 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:17.954047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:17.956411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 369/713] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:17.964056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:17.964709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:17.965186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.003585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55489c28-73b3-4ed4-b44b-c4da0c5d5823 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:18.005265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:18.006876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:18.040856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:18.041467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:18.041800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:18.042374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.042938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] RBAC: Adding query filter params (name=network) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:18.043255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:18.044710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:18.050567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 345/714] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:18.058316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:18.118635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 370/715] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 14:35:18.161432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:18.238591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bae22-96a7-4c2c-9d16-7326d54eb997 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:18.295131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:18.311196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:18.311946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:18.312234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:18.312509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.313229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] RBAC: Adding query filter params (type=network) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:18.313541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:18.314928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:18.315807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:18.323617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 346/716] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:18.358460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4aaf6-d045-48ce-aab2-4f00dc80919f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:18.414791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:18.416020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:18.416518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:18.416998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.433644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:18.435487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:18.461684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:18.462996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:18.464151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:18.464151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:18.464151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:18.464151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:18.466219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 371/717] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:18.472263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:18.622943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b557-dde3-4096-8502-49994d28e605 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:18.657804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:18.658839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:18.659327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:18.659833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.660821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:18.661335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:18.663392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e001eb-d71e-45a0-b091-a6dc4645de6d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:18.676431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 347/718] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:18.684528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:18.814328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77782050-9ac8-4fa6-8caf-e2215c57063d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:18.842424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:18.850993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:18.852161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:18.852848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:18.853128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:18.853850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:18.855728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309da1d-6bbb-439c-8e06-73461f80be68 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:18.878968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 372/719] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:35:18 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:19.391746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2cd9-1ac4-4fb7-b069-36453d0a6b51 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:19.392270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2cd9-1ac4-4fb7-b069-36453d0a6b51 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:19.392270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2cd9-1ac4-4fb7-b069-36453d0a6b51 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:19.393905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 348/720] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:19.400305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:19.400751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:19.401216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:19.427156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:19.429022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:19.503332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 373/721] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:35:19.542023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd2cd9-1ac4-4fb7-b069-36453d0a6b51 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:19.600402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:19.656191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd2cd9-1ac4-4fb7-b069-36453d0a6b51 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:19.691682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:19.692479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:19.692765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:19.693040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:19.704890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:19.713331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:19.714476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:19.715502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 349/722] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:19.723487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:19.902472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1676ad-615d-44d2-a83a-01fce0990c1e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:19.925695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:19.953529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:19.954213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:19.954498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:19.954775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:19.955564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:19.955879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:19.957261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:19.970273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 374/723] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:19.976372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.136698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e6eb3-cd79-4891-9ecf-a964a42549a9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:20.160964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:20.192945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:20.194483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.194916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.195260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.217682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:20.219331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-245974ca-a7db-41a1-891a-84f7b3c499df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:20.244494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:20.245503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:20.246473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:20.246473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:20.246473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:20.246473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:20.251594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 350/724] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:20.253887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.367836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4c850-d383-4abc-92a5-f340932d8095 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:20.375032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a73e3-adbb-4b53-95e8-9766fcfcee2e None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.375614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a73e3-adbb-4b53-95e8-9766fcfcee2e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.375894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a73e3-adbb-4b53-95e8-9766fcfcee2e None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.377249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 351/725] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:20.383287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160269b-bca4-4c35-ad71-9691d87979da None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.383891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160269b-bca4-4c35-ad71-9691d87979da None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.384391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160269b-bca4-4c35-ad71-9691d87979da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.416005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e160269b-bca4-4c35-ad71-9691d87979da None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:20.417369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e160269b-bca4-4c35-ad71-9691d87979da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:20.435247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:20.435966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.436251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.436528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.437267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:20.437572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:20.438943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1f1a-cb9a-4578-a3da-01413d2f59a7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:20.452603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 375/726] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:20.453858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3465c-bf50-45c3-a55d-03cd63fc194b None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.454179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3465c-bf50-45c3-a55d-03cd63fc194b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.454423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3465c-bf50-45c3-a55d-03cd63fc194b None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.456027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 376/727] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:20.459867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3465c-bf50-45c3-a55d-03cd63fc194b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.509193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:20.520454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 352/728] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 14:35:20.522106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.522889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.523266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.544467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:20.546021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:20.615996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3465c-bf50-45c3-a55d-03cd63fc194b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:20.656919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:20.658034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.658464 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.658882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] PATH_INFO: `/v3/users/swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.667950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:20.669861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:20.687059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:20.688287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:20.689443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:20.691757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 377/729] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:20.692909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.760626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 353/730] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:20.761488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.789352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:20.801276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:20.809752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7edaa7-72ea-49a5-bfa8-32d2cc2f7fcf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:20.848756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:20.850580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.851093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.851602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.863794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:20.873328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:20.874338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:20.875178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:20.875840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2387e-2f4c-4ac8-84ef-d274f6678a4e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:20.878075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 378/731] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:20.879082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:20.919605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:20.920343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:20.920608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:20.921092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:20.922135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:20.922583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:20.924443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:20.946217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 354/732] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:20.947507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.000613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918ad06-4549-46d9-991e-f6fd6f833607 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.035702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.048764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.049713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.050033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.050318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.051181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.052644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.059268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1e5b-3d22-40bd-a23a-3168000e5e72 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.069363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 379/733] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:20 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:21.069991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.094013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.125432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.126671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.127282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.127819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.128824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:21.129399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.131500 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c8c94-44f1-4f04-803a-e359a8b28d12 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.147737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 355/734] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:21.149700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec893a-c812-4ab4-a5b3-6e0c07efcaba None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.150206 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec893a-c812-4ab4-a5b3-6e0c07efcaba None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.150678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec893a-c812-4ab4-a5b3-6e0c07efcaba None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.152792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 356/735] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:21.153988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec893a-c812-4ab4-a5b3-6e0c07efcaba None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.192731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93667d-ce57-4025-8e6b-b1e979a977bf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.232806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.233742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.234167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.234599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.293297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec893a-c812-4ab4-a5b3-6e0c07efcaba None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.314084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.315659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.335168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.349639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.351320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.351663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.352092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.364607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.368825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.371381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-5be55107-0a2a-41cf-bd50-cbf9928ce353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:21.394626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:21.395835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:21.397754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:21.397754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:21.397754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:21.397754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:21.401416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 357/736] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:21.403214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899858f-37b7-485a-b040-542fc6068927 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.403719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899858f-37b7-485a-b040-542fc6068927 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.404178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899858f-37b7-485a-b040-542fc6068927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.431914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5899858f-37b7-485a-b040-542fc6068927 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:21.433363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5899858f-37b7-485a-b040-542fc6068927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:21.457597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 380/737] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 14:35:21.460000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.519932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 358/738] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 14:35:21.519932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899858f-37b7-485a-b040-542fc6068927 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.591507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31f247-33af-4763-98be-e46bed952a61 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.617365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.626202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899858f-37b7-485a-b040-542fc6068927 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.636811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.637968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.638960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.638960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.639863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:21.640308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.642425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.651250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.660723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 381/739] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:21.661881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.666417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.667438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.667931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.668414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.680876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.682634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:21.703608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:21.704544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:21.705427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:21.705427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:21.705427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:21.705427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:21.712220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 359/740] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:21.713454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.793806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782c95a-3e4c-49c0-98c5-2d4679d1bd03 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.837802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edefbc9-abb8-4ad3-833f-4ffdea8555de None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:21.839304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.840358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.840744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.841103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.842860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.844369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.871481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 382/741] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:21 2022] POST /identity/v3/services => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:21.871481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.906133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:21.907052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.907339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.907729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] PATH_INFO: `/v3/users/nova` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.913083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:21.918932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:21.921389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-fe9cb780-4bb1-4f04-905d-3f5539f0520f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:21.940179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:21.941247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:21.942182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 360/742] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:21.943585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bead-454e-4d41-91af-86a400a78448 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:21.943935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bead-454e-4d41-91af-86a400a78448 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:21.944238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0bead-454e-4d41-91af-86a400a78448 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:21.950314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 361/743] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:21.951326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0bead-454e-4d41-91af-86a400a78448 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:21.993642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.003670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cce59-7b03-49e8-8cfd-17171a914944 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.051961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482509-92e7-4127-8442-a8714dea158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.053502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482509-92e7-4127-8442-a8714dea158c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.053788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482509-92e7-4127-8442-a8714dea158c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.054066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482509-92e7-4127-8442-a8714dea158c None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.054930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482509-92e7-4127-8442-a8714dea158c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.055236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482509-92e7-4127-8442-a8714dea158c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.056772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482509-92e7-4127-8442-a8714dea158c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.069660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 383/744] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.070754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.071040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.071316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.077190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0bead-454e-4d41-91af-86a400a78448 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.088866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:22.090116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:22.122949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.124241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.124529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.124807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.125665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.125977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.127437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.151583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 362/745] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.152499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.176155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 384/746] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:22.179583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.229183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.269326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.284473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dcfd6-919d-4267-8eae-6c0a67f26cd7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.323154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.323997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.324279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.324555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.331671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.333038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a01b8-4cc2-40c1-ba64-c870d7be49bb None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.333157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:22.347755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:22.348699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:22.349584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 363/747] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:22.350093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.375490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.376215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.377066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.377345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.394002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.395492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:22.419942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:22.420877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:22.421759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:22.421759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:22.421759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:22.421759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:22.424188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 385/748] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:22.425553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.484590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae09d0-d004-4e7d-83ff-245905966ac6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.530746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.531861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.532146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.532450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.543177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.548390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:22.560387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:22.561336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:22.562462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:22.566928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 364/749] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:22.568444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.574664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61270a02-9fb9-4d92-8ba8-06e369df829f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.582037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.613647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.614658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.615122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.616435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.617620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.618391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.620179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.635892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 386/750] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.637455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.719220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb942858-055a-43cf-8f12-157f5651d840 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.759641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35278aa-f0ec-488b-8b6d-6f14fbcf8d58 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.765043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.765933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.766398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.766853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.767800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.768311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.770022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.783583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 365/751] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.784747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.803986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.804670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.804992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.805273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.806480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.806793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.808252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.816229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.829929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 387/752] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.829929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:22.870595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:22.909169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42babb7-6e90-45e4-b75c-065ab55fbbd7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.965897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbf042-6659-44db-a138-0c22963655bf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:22.966258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:22.967144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:22.967684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:22.968183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:22.969432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=a52d17454c264a51a14b1d6a7786b570) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:22.970026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:22.971701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:22.979209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 366/753] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/role_assignments?user.id=a52d17454c264a51a14b1d6a7786b570&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:22.980402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.008029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.009331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.009855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.010371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.019180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.021375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:23.038271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:23.039274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:23.040195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:23.042957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 388/754] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:23.050178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.110014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bd34d-80dd-42c7-ac74-9113db56b6b5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.150148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.156683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.157507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.157789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.158088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.179602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.179602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.181921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:23.198287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:23.199273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:23.200193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:23.200193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:23.200193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:23.200193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:23.200193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 367/755] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:23.205647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.278110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29bc6-1719-47c9-8558-1eab96a8dca6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.321348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.322018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.322371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.322558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.323356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:23.323702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.325140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.339786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fde48-e3d4-41f2-84c7-09ec32247c2a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.342405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 389/756] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:23.343685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.376521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.377192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.377529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.377846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.378582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:23.378886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.380473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28916dc4-05c2-41df-8180-75aab6720fc9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.393998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 368/757] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:23.400185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373517d-2ee9-4da6-9b40-271df2f42a91 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.400479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373517d-2ee9-4da6-9b40-271df2f42a91 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.400762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373517d-2ee9-4da6-9b40-271df2f42a91 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.402556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 369/758] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:23.403485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373517d-2ee9-4da6-9b40-271df2f42a91 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.451059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9494b-9026-4fed-98cd-3fd4b2d57ee0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.463129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.479882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.493976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.494964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.495249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.495547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.497664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=54774acef6c54a06a81facfe13173568, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.499199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacaea3-09a7-4675-acb5-ed8e0c9f9e36 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.523531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 390/759] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:23 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:23.523832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373517d-2ee9-4da6-9b40-271df2f42a91 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.531479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.531479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.531479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.565303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:23.567509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:23.574133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.575026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.575320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.575635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.592229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.593730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:23.626407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:23.627411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:23.628375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 370/760] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:23.635282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.729026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 391/761] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:23.765213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.772600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd78cbf-5521-4dd6-b7c9-dc1676c062c5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.775110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.816620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.817314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.817599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.817878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.818869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:23.819190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.820827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.843223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 371/762] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:23.848436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:23.905853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f70ce5-7da8-4754-bd8a-ee02e8cbee20 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:23.930244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:23.969678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:23.970503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:23.970785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:23.971059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:23.971761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:23.973134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:23.994309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:23.995271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:23.996161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:24.011892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 392/763] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:24.012868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.028162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab50978-6337-4de7-ae39-cc0eb13d339b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.101582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.102243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.102522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.102797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.157933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:24.232326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7819006-2337-4e58-87e1-63031099b84e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.236097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.237834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd72341-e1ac-4c54-b687-cf5152c15d2b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.308819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.310504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.311277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.312075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.313885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:24.314741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.317879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05038-ff12-4026-b84e-1cbd3911a28e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.328885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 393/764] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:24.332146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a9b6-1d82-4e84-95b8-be58e8125773 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.332968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a9b6-1d82-4e84-95b8-be58e8125773 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.334016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90a9b6-1d82-4e84-95b8-be58e8125773 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.337962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 394/765] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:24.339945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90a9b6-1d82-4e84-95b8-be58e8125773 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.372744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 372/766] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:24.372744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.372744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.372744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.402250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:24.406158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:24.410754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:24.508748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90a9b6-1d82-4e84-95b8-be58e8125773 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.516135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:24.530792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 373/767] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:24.532496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.578314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.579477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.580308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.580608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.581896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:24.582505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.584971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.595567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 395/768] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:24.597060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.648985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764e35-0de2-47a3-92d9-7b23e7344e19 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.689746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.690965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.691403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.691854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.703250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.705132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:24.724674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:24.726339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:24.727409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:24.727409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:24.727409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:24.727409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:24.729262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 374/769] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:24.730338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.781025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48d0cc-f8e2-4643-8fe2-328af68b5c4b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.783781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:24.791691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:24.843186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.844135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.844520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.844898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] PATH_INFO: `/v3/services/network` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.845684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.847210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.855049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009fa5-4001-422f-ba00-f1cf47bd4dd2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:24.861566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:24.863022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:24.864091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:24.866854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 396/770] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:24.868303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.898550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:24.899562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:24.900002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:24.900455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:24.901431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] RBAC: Adding query filter params (interface=public, service_id=b73b88df00eb4eb8a657418d90a55709, region_id=RegionOne) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:24.901900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:24.903515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:24.913328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 375/771] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/endpoints?service_id=b73b88df00eb4eb8a657418d90a55709&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:24.914620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:24.991972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2cd12-4069-47fa-b6a5-c79199153cd8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.030135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679702b-d287-4383-b97e-e0945430b08a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.033539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.034255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.034611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.034957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.035817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.036199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.038259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.042795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.060772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 397/772] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.062058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.072858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.073762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.074153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.074532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.075365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] RBAC: Adding query filter params (name=network) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.075894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.077688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.083085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 376/773] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.084078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.097079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.186612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d925ae-37c2-45e1-9afa-8b73e585d4ea None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.195801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22501e-5a31-4ef8-9ffa-b5dda19c5049 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.232839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.234148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.234795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.235070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.235577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.236108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.236490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.236830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.237200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.238731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.246501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 398/774] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.247980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.248542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.249695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:25.266256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:25.267213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:25.268383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 377/775] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:25.273976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.312034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.374958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.388144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3f365-1027-4239-9f46-557b41855a81 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.414300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d406-df9d-4827-83c0-26ae3bb151e4 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.432222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.433380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.433920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.434430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.435380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] RBAC: Adding query filter params (type=network) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.435920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.437576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.444401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 399/776] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.453413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.466428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.467167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.467479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.467776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.468650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.468965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.470483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.492570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 378/777] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:25.498486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.586284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402a7c-a1a4-44ab-94b7-b5219eb4c6f1 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.621648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.633157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.633747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.634029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.634301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.635100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] RBAC: Adding query filter params (interface=public, service_id=9df6b643da014334989f3d4aa3e05e8b, region_id=RegionOne) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.635408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.636813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7e7b1-84b0-4794-b227-fe7ef8f8640f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.641153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba2b3-78f0-400d-8183-1481ea3b153f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.649784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 400/778] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/endpoints?service_id=9df6b643da014334989f3d4aa3e05e8b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.651271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516c2b-384a-4fd2-922c-2dfeb8782d39 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.651595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516c2b-384a-4fd2-922c-2dfeb8782d39 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.651874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516c2b-384a-4fd2-922c-2dfeb8782d39 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.655514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 401/779] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:25.655514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516c2b-384a-4fd2-922c-2dfeb8782d39 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:25.679036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:25.691133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.691982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.692498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.692885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.693982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=b698cb9f41704c67aeb2c667b7a7324e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:25.694399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.696216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb2e04-a701-4c06-8e65-cd34f5490abd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.703035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 379/780] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/role_assignments?user.id=b698cb9f41704c67aeb2c667b7a7324e&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:25.709836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a5f1-91d0-4cf1-bc80-dbae74269ef2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.710230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a5f1-91d0-4cf1-bc80-dbae74269ef2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.710743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42a5f1-91d0-4cf1-bc80-dbae74269ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.741328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-0c42a5f1-91d0-4cf1-bc80-dbae74269ef2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:25.742817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0c42a5f1-91d0-4cf1-bc80-dbae74269ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:25.777510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516c2b-384a-4fd2-922c-2dfeb8782d39 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:25.825647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:25.826666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:25.827092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:25.827564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:25.828456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:25.830065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:25.847664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 402/781] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:25.902541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 380/782] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:25.937058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.041775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:26.061432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100a191-7dc1-4dc6-8474-ad35edd43e39 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.068477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e211b8-210e-4ee2-bddb-885f8fa55791 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.069310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e211b8-210e-4ee2-bddb-885f8fa55791 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.069583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e211b8-210e-4ee2-bddb-885f8fa55791 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.071245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 381/783] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:26.078925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.079563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.080076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.105044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.105417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:26.106436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.106696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:26.107175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.107797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.121406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:26.129768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:26.130752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:26.132150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:26.136039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 403/784] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:26.141691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.214287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 382/785] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:26.283850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.288491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dab8b-bdf0-4925-a491-75c9310f179d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.320137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:26.330255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.332252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.332715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.333323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.335000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:26.335702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:26.337917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:26.356614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 404/786] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:26.362569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.369121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:26.477995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bdabc-1d68-46c1-b196-bc30efdb45a3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.539474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb75c-463c-44a8-b050-6e43f0821813 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.571829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.572635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.572928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.573213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.576191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.577009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.577298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.577581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.592678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:26.594197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:26.595311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:26.603255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:26.604264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:26.605072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:26.607289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 383/787] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:26.617012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:26.624620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:26.625505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:26.626373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:26.626373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:26.626373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:26.626373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:26.629156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 405/788] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:26.638434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.711333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:26.760758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760353a-1d3f-417b-bc6b-dd9c92fe49aa None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.776424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:26.820913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.821960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.822479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.823000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.823995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:26.825936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:26.827559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:26.846522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 384/789] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:26.851070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfe530-bc20-4796-bf93-377699d6e764 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:26.853267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:26.922396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:26.923524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:26.928467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:26.929032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:26.930017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:26.930538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:26.932196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:26.954108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 406/790] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:26.958019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.034466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8395df-1d0f-4a8d-a644-a22bca64a8b2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.092870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6805f8-db91-4e6e-a11c-a3e2ccd14c7f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.115835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.121868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.124387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.126237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.126740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.144344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.145568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.146112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.146626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.151814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.156310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.157823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.163293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.166830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:27.193958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:27.195056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:27.196937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:27.196937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:27.196937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:27.196937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:27.196937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 385/791] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:27.205838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:27.210186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:27.211094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:27.213010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 407/792] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:27.220606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.358916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e90f6-ce2a-4c19-8c53-d577735df2b5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.366104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773d48-4867-4c13-9e47-ebd0a4c210ac None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.403180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.403889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.404174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.404509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.405411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:27.405728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.407170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.409095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.409778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.410069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.410355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.411107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:27.411429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.413537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.426480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 408/793] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:27.431782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.438685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 386/794] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:27.444039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.510819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.513295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.554647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdd223-c99a-472b-ba49-73d653b0fc10 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.591102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.591947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.592237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.592522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.601878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.603337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:27.620118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:27.621080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:27.622001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 387/795] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:27.627004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.699479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473293d7-8d59-47e5-9593-f70bbc06ec42 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.752935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a44b8-f502-42d0-8838-6bb9c92e5d28 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.775576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.776772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.777296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.777795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.785457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.797690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.799181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.803852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:27.804556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:27.804886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:27.805173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:27.806047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:27.806362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:27.807837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:27.828164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:27.829110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:27.829992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:27.829992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:27.829992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:27.829992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:27.829992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 409/796] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:27.837228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.840096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 388/797] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:27.848440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:27.949953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:27.966379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2d5e2-c394-4d19-a828-1687c04237e4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:27.973251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce5821-dba3-437a-8ff4-d8264532d855 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.011544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.012497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.012851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.013204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.014224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.014889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.015174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.015469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.016217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:28.016812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.019203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a141-368f-4cde-b1c5-c45617c7454f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.035380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 410/798] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:28.036821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b4514-2713-4ec0-904b-5bfc02796160 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.037116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b4514-2713-4ec0-904b-5bfc02796160 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.037400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b4514-2713-4ec0-904b-5bfc02796160 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.039616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 411/799] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:28.043775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b4514-2713-4ec0-904b-5bfc02796160 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.064030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.106488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.108182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4f2a-3280-4b22-9791-d9f30c65bed2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.202184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b4514-2713-4ec0-904b-5bfc02796160 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.221486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 389/800] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:28.221486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d10-036f-404b-b8c9-be6585659962 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.221486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d10-036f-404b-b8c9-be6585659962 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.221486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7d10-036f-404b-b8c9-be6585659962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.237892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f63b7d10-036f-404b-b8c9-be6585659962 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:28.239177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f63b7d10-036f-404b-b8c9-be6585659962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:28.259045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.260233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.260617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.260966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.271033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.273441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:28.302710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:28.304342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:28.305210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:28.305638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 412/801] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:28.306748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.322185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.323628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.330495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 390/802] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:28.331841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b0ae-e2f5-43cd-a641-c7f93fd18d7c None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.332123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b0ae-e2f5-43cd-a641-c7f93fd18d7c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.332404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6b0ae-e2f5-43cd-a641-c7f93fd18d7c None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 391/803] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93ac2-28b4-4747-9cdb-6975fbc63916 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93ac2-28b4-4747-9cdb-6975fbc63916 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93ac2-28b4-4747-9cdb-6975fbc63916 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 392/804] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:28.339331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93ac2-28b4-4747-9cdb-6975fbc63916 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.431204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6f143-5ea4-484e-9ca6-b3985b6f37fe None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.459082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93ac2-28b4-4747-9cdb-6975fbc63916 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.471435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.472266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.472547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.472824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.485545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.487027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.498343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.499009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.499293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.499601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.500409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:28.500723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.502173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02de1e-39ab-4552-805b-287497c72d49 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-4e33cae4-da77-4c6b-99ed-d4ee35adbbc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:28.505663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:28.507062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:28.508189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:28.508189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:28.508189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:28.508189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:28.508189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 413/805] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:28.509096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.509392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.509672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.520446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 393/806] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:28.520446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.520446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.520446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.536232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:28.537499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:28.538846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:28.540439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:28.601828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.603705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.616211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 394/807] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:28.617078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.627564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 414/808] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:28.627564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.748901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab7934-d3eb-4ebb-ad90-13515d78dfcc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.759280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86d025-c2bd-4bfb-83fc-18e23cb07942 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.785091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.785754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.786032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.786313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.787038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:28.787350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.788750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.794878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.795719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.796008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.796287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.797322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.798308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.800320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 415/809] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:28.800975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:28.815314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:28.816343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.822836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 395/810] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:28.823702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.850048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.875876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:28.904221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c665-4191-402a-9e7b-1ca77ae87c1e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.923385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2c58-5cb0-47df-9a2e-b84aae61f0fc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:28.941832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.942749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.943026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.943297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/a52d17454c264a51a14b1d6a7786b570/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.945889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=a52d17454c264a51a14b1d6a7786b570, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.947346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.959105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:28.959950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:28.960237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:28.960520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] PATH_INFO: `/v3/services/network` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:28.960642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 416/811] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:28 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/a52d17454c264a51a14b1d6a7786b570/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:28.961185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:28.961363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:28.962735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:28.986836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:28.988452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:28.989342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 396/812] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:28.990439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.097860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b17c-3146-4438-9347-14b7a71715c4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.109445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.114812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd6519-2689-4124-baa6-07d4ba3e8193 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.134834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.145932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.146737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.147049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.147325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.154489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.155377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.155694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.155976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.157924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:29.163581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.165034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:29.166230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:29.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:29.168020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 417/813] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:29.168700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:29.189338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:29.190288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:29.191167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 397/814] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:29.191689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.284129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c5f59-dc59-4cb7-a1ac-f1ff35e2a2d2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.296532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65395e87-e50e-4988-b58a-693f574b38e0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.320380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.321046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.321328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.321608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.322326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.322637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.324055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.333103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 418/815] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.333103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.337709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.338500 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.338911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.339311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.340236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] RBAC: Adding query filter params (name=network) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.340667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.342177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.347719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 398/816] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.348651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.373003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.396463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.446360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105fd9f-f3d1-4f42-b165-2391cca81163 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.462176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa54d6-8d54-4a92-9f11-aafbede65b11 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.482303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.482977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.483262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.483567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.484774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.485085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.486609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.496355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 419/817] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.497174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.502956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.503907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.505042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.505042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.505275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.505637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.507233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.529455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 399/818] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.529455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.613651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.622464 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2640e8-2809-4113-b3e6-af961dcb3dff None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.651150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.655281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1399-d8ad-41f8-bc63-0585c65669d8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.665007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.665007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.665007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.665007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.665582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.666201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.667218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.679619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 420/819] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.679619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.713736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.714513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.714804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.715083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.715860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] RBAC: Adding query filter params (type=network) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.716172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.717564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.723132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 400/820] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.724005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.809877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30faef-68b0-49b4-a4d3-63165a14ea69 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.858056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ff22-c83e-4aaf-82dc-525eafe99840 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:29.863966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.864777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.865067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.865350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.878954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.880490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.899722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:29.900708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:29.901183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:29.901600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:29.903001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:29.903813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:29.905763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:29.907015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:29.908263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:29.908263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:29.908263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:29.908263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:29.908761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:29.911853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 421/821] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:29.912780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.916697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 401/822] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:29 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:29.917616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:29.942131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:29.969665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:30.077415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc684-e35e-4a9d-9e3e-a831cca23203 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:30.100768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d9a36-d4d8-4fe8-8fcb-4d691714ae09 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:30.140563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:30.141611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:30.141970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:30.142337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:30.143186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:30.144875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:30.146723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:30.147981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:30.148268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:30.148537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:30.149372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:30.150909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:30.175277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 402/823] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:30.176085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:30.176216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 422/824] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:30.300713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:30.335089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b73ed6-0ade-427c-8fc6-b836564e163f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:30.400832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:30.401444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:30.401736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:30.402019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:30.402774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:30.403090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:30.404537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:30.422477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 403/825] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:30.428327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:30.508096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:30.566342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb4ed-796e-4532-bb24-ebc01214be48 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:30.608018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:30.608856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:30.609144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:30.609422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:30.619059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:30.620569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:30.636660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:30.637658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:30.638599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 423/826] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:30.647241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:30.791361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877704-b04c-475f-bace-cb127c0cc3ef None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:30.833972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:30.835286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:30.835603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:30.835886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:30.836836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:30.837156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:30.838743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12787a6-ca8e-4c93-9eab-f05150d4e039 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:30.841759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:30.868550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 404/827] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:30.876666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.079586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09232-c4b3-46f7-b025-675c7e11c27d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.115481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:31.147913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:31.149248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.149751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.150248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.167481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5511d3-4d8c-4152-8b80-93f880d1ed0f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.167481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5511d3-4d8c-4152-8b80-93f880d1ed0f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.167481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5511d3-4d8c-4152-8b80-93f880d1ed0f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.168159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 405/828] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:31.172139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:31.173965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.174257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.174546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.174818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:31.209482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:31.211742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:31.213562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:31.213562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:31.213562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:31.213562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:31.216791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 424/829] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:31.220986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:31.220986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:31.224834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.363363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c7f32-880b-401d-a11a-c761c02186df None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.400726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:31.401769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.402257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.402784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.403755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:31.404267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:31.405858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:31.416973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 406/830] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:31.421032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 425/831] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:31.425975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.448569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.538228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7374b54-a214-4cdb-9243-6bb05d0439e5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.582143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:31.643568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:31.692721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:31.694637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.695084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.696551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.714463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:31.718772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:31.739508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06185981-d81b-496b-8d95-aeeab71d4edb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:31.758979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:31.759955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:31.760815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:31.762938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 407/832] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:31.773327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.799070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:31.800296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.800787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.801262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.828962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:31.838510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:31.839407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:35:31.840534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:31.843027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 426/833] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:31.851918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:31.923564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92381b2-98c4-48c1-9115-4a4828ff2a3f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.954989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:31.959836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3f2b8-f36c-41f3-b625-b7e4d935800d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:31.968423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:31.969357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:31.970196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:31.970709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:31.972214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:31.972787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:31.974548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:31.991699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 408/834] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:31.997079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.004901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.005581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.005864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.006144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.007538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:32.007858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.009483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.022379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 427/835] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:32.025048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.064664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:32.129965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c57d7-d224-4e3d-889a-5cc89643dcb0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.142916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca310d-5f92-4977-bb6a-085f323ca05d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.168339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.169585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.170178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.170676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/b698cb9f41704c67aeb2c667b7a7324e/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.185913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.186510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.186798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.187075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.190144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=b698cb9f41704c67aeb2c667b7a7324e, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.191840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.198921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.200496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.216126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 409/836] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:31 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/b698cb9f41704c67aeb2c667b7a7324e/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:32.232681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:32.233640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:32.234507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:32.234507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:32.234507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:32.234507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:32.234507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 428/837] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:32.241997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.351392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:32.359211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5ec1c-6707-49aa-bd46-d38ab1995cb6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.410545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.411250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.411540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.411818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.412560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:32.413490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.415026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.428054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 410/838] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:32.434124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.451217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:32.550340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed576b5-4ffe-4fc9-bf8e-5c558e0dcff0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.589965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.590819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.591109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.591388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] PATH_INFO: `/v3/users/swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.600031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.601538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-9101ffae-902f-445d-94e8-c4cc7986230c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:32.617268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:32.618407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:32.619729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 429/839] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:32.626485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.670971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23649-9358-433e-bcdc-fc2143b18b6b None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.671315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23649-9358-433e-bcdc-fc2143b18b6b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.671577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce23649-9358-433e-bcdc-fc2143b18b6b None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.673217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 430/840] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:32.678128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638582-0ec2-47f3-89de-3c63454e8ef2 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.679008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638582-0ec2-47f3-89de-3c63454e8ef2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.679295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638582-0ec2-47f3-89de-3c63454e8ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.697502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-26638582-0ec2-47f3-89de-3c63454e8ef2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:32.698699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-26638582-0ec2-47f3-89de-3c63454e8ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:32.740631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1757d-e50f-46ef-9312-9e6b72a1be7c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.787109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.787337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 431/841] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:32.787421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.787421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.787421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.787625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877315e7-8c10-4002-be2d-c04b9540390a None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.787625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877315e7-8c10-4002-be2d-c04b9540390a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.787625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877315e7-8c10-4002-be2d-c04b9540390a None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.788493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:32.788493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.788699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 432/842] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:32.788771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:32.796527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.796811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.797089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.808762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:32.817921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 411/843] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:32.819157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.820841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:32.822099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:32.836675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:32.901617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 433/844] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:32.902653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:32.950674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2124b-6fca-4314-a301-313836a36a64 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:32.987528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:32.988601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:32.988877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:32.989154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:32.989812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:32.991908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:33.004465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:33.005462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.006282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 412/845] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:33.007172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.021393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27323b-81de-4775-8a2a-3ee923278dc7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.060966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.067047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.068134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.068730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.069281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.106627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.133052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a222-cd1e-4b5b-b953-11e8c384bcd5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.153356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.154822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.169058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.169849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.170130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.170405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.171058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.172456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:33.184992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:33.186048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.186951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 413/846] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:33.187852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.277545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 434/847] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:33.277545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.306471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.316417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59253af5-388d-4a67-b5ba-e5414e84777a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.359912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.360583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.360871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.361150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.361864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:33.362173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.363889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.369298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 414/848] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:33.370098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.375064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.388816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e68e-8b36-4dbf-ad38-938692e133d9 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.427290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.428001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.428285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.429083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.430163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:33.430163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.431698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.441687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 435/849] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:33.441687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.489799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb4a7-8ae5-44f4-bbd5-1cbf7c3554e2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.542062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.542964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.543326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.543651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.548239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.557427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8dc5-f08b-4b50-b5c7-48c44e02346c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.561253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.562728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:33.584723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:33.585712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:33.586606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:33.586606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:33.586606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:33.586606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:33.587592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 415/850] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:33.588498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.596665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.597621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.598097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.598570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.599514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:33.600009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.602095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.607292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 436/851] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:33.608480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.672935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.743203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10797e-adf3-4662-96ad-00a193963562 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.749064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f831-738c-45c3-b427-eee7ef43e3b0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.789777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.791382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.791956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.792446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.793328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:33.793696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.795692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.800568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.800738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 416/852] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:33.801250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.801538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.801820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.802571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:33.802892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.804911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:33.818391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 437/853] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:33.824249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:33.939922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4630a8-92d1-4eff-b4c7-09c83fead35f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:33.962446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:33.978713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:33.979547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:33.979832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:33.980112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:33.987491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:33.989207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:34.004145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:34.005095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:34.006013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 417/854] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:34.013209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:34.047961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:34.250149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac986a14-39b9-4e23-aecc-0c8621af2f6b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:34.288682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:34.289389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.289677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.289955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.290759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:34.291073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:34.292588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea33d6-3d79-417e-a6ae-5bcf0db9cc16 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:34.305989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 438/855] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:34.311855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:34.399528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2e3c-e73e-4c22-afa4-c1ff6a0d11cd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.399896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2e3c-e73e-4c22-afa4-c1ff6a0d11cd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.400092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2e3c-e73e-4c22-afa4-c1ff6a0d11cd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.401719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 439/856] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:34.406720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.406971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.407208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.421701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5069d-a2f7-4232-b816-8d189b7a050c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:34.426248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:34.427714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:34.473414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:34.474090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.474381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.474662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.475575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=a52d17454c264a51a14b1d6a7786b570) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:34.475898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:34.477596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:34.486393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 418/857] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:34 2022] GET /identity/v3/role_assignments?user.id=a52d17454c264a51a14b1d6a7786b570&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:34.523477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 440/858] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:34.545394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:34.601706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:34.666222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9e16-7abe-4a0d-a7f3-f88350716a7f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:34.702513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:34.703318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.703638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.703918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.715405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:34.723232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:34.724219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:34.725038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 419/859] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:34.731341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:34.743897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:34.842066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47a5d-d309-46f3-b4e2-2e9a1e9f0359 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:34.878703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:34.879295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:34.879610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:34.879887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:34.880650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:34.880959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:34.882370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:34.891366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 441/860] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:34.897062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.008336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbcc1-ed2b-4ef2-a6de-505c4abc24eb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:35.010931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:35.052343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:35.053629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.054128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.054620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.066301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:35.068072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:35.086901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:35.087846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:35.088712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:35.088712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:35.088712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:35.088712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:35.090911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 420/861] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:35.096463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.175114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:35.206415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a17fc5-3922-48dd-b14d-92263585c3e0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:35.241185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:35.241853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.242132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.242406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.243135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:35.243437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:35.244822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:35.258286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 442/862] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:35.263481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.379478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf00a-df72-4a70-8722-3c959c1f5e8f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:35.415742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:35.416570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.416858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.417138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.425532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:35.426972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:35.442441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:35.443621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:35.445262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 421/863] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:35.450185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.563557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330259-0ed3-45f0-9568-0ccbde861ee3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:35.594915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:35.600558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:35.601300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.601731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.602203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.603055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:35.603367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:35.604950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d36735-8366-4775-9a64-93bcb6afd9ac None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:35.624441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 443/864] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:35.629701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.649478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:35.742676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492f5d-aaa8-4923-883c-faf2b46211fd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:35.778829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:35.779559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.779848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.780126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.813549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677550c-1937-4691-a6ef-e1cc9a393b9f None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.813889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677550c-1937-4691-a6ef-e1cc9a393b9f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.814106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677550c-1937-4691-a6ef-e1cc9a393b9f None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.819343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 444/865] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:35.821375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:35.821657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:35.821931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:35.841155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:35.842575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:35.860104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:35.861577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:35.884030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:35.923669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 445/866] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:35.940845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:35.976385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 422/867] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:35.984612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.046826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627610f-56f9-4e2a-8c3e-2d2cfae35bd9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.069895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.086853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.087554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.087845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.088128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.088859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.090234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6c08-ae94-4056-84a3-331ab62eccb0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.094269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0219f3-6cae-4060-b242-91bc1fbc52c6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.104815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 446/868] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:35 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:35:36.114098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.117120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdf38-d312-4cc6-a9e6-2adf38c270a7 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.117412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdf38-d312-4cc6-a9e6-2adf38c270a7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.117700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cdf38-d312-4cc6-a9e6-2adf38c270a7 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.119255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 447/869] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:36.125555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.126477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.127527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.143779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.144690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.145005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.145282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.153313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:36.156138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:36.158372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.160026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:36.181968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:36.182970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:36.183911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:36.183911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:36.183911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:36.183911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:36.187920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 423/870] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:36.189677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.265069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 448/871] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:36 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:36.289294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.313968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b469f-ecdc-4ffe-bb9a-8b5dc3e1e21a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.355350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.356128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.356411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.356712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.357573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:36.357794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.359176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.371994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 424/872] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:36.377468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.404223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.406820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de51a6-3aa1-4921-947a-0b850d5aebb6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.423832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.447245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.448373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.448884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.449353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.450274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.452075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.470412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 449/873] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:36 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:35:36.489382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463727e-7799-4cc7-bc61-b0ba76b2a7f3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.537369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.538707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.538993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.539272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.547654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.549136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:36.566095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:36.567028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:36.567934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:36.571797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 425/874] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:36.573544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.692006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53682-a29e-40a1-a8c2-07f9c72dc65c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.729580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.730588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.731053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.731529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.732539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:36.733040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.734730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf86f-2812-467e-9f1d-48f753ee64d5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.749436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 450/875] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:36.755715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.778856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9f4e7-6230-420e-bd71-f283195f9892 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.779210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9f4e7-6230-420e-bd71-f283195f9892 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.779419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9f4e7-6230-420e-bd71-f283195f9892 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.781089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 451/876] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:36.789513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.789936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.790433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.808942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:36.810307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:36.844171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.847645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:36.875530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629a7b5-95d6-491b-a28a-ebdbb3282295 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:36.895946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 452/877] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:36.922468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:36.925020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:36.926664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:36.927224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:36.927539 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:36.928610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=b698cb9f41704c67aeb2c667b7a7324e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:36.929571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:36.931217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:36.943559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 426/878] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:36 2022] GET /identity/v3/role_assignments?user.id=b698cb9f41704c67aeb2c667b7a7324e&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:37.057194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042964b-b4ac-4bc1-b7a6-3cf048116d24 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:37.096647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:37.097377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:37.097662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:37.097938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:37.098616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:37.100058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:37.114741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:37.117707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:37.119682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 453/879] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:37.122876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:37.245648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e404d-d1b9-4e2c-b161-b332504a98b6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:37.288772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:37.290220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:37.290763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:37.291292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:37.292518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:37.293262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:37.295599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf791d24-7a4c-454d-8364-5ccd9d1566cd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:37.302092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 427/880] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:37.307840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:37.336111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:37.428639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fd377-7cb0-40b6-8b14-2ce32f307287 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:37.466567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:37.467238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:37.467547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:37.467829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:37.468556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:37.468874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:37.470254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3190-a5ff-45b6-9300-b2baf17d97c5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:37.475348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 454/881] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:38.333902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454d71-7039-4591-94cc-d8279729e5cf None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.334472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454d71-7039-4591-94cc-d8279729e5cf None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.334472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60454d71-7039-4591-94cc-d8279729e5cf None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.336209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 428/882] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:38.341599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.342013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.342183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.359520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:38.360717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:38.429883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 455/883] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:38.453084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454d71-7039-4591-94cc-d8279729e5cf None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:38.466269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:38.566330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60454d71-7039-4591-94cc-d8279729e5cf None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:38.602420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:38.603168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.603475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.603763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.604436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:38.605810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ea922bb4-e7c6-4024-a008-447dbf54396b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:38.618925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:38.619934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:38.620744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 429/884] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Jul 20 14:35:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:38.628867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:38.651173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:38.652031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01848c4-5c6e-467e-b09d-c9f13e7036eb None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.652397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01848c4-5c6e-467e-b09d-c9f13e7036eb None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.652752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01848c4-5c6e-467e-b09d-c9f13e7036eb None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.655116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 430/885] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:38.661308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.661672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.662451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.684800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:38.686700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:38.748237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883bf7-26b5-48a8-aaa1-e0e9da260277 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:38.775611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 431/886] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:38.791960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:38.792639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.792923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.793257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.793986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:38.794295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:38.795714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:38.799480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:38.801656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:38.806305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 456/887] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:38.812099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:38.897723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:38.918684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396133-cdb3-4053-bc72-d4e2a52decbb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:38.931031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039c1b2-48fa-47d6-87b2-3fe489cb6775 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:38.964706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:38.966271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.966886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.967853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.968971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:38.969804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:38.971835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:38.978073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:38.979781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 457/888] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:38.980390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:38.980922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:38.984738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:38.984738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:38.986248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:38.986359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:39.001667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:39.002741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:39.004013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:39.007538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 432/889] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:39.009678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.097108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.106159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eeec6-c904-4d28-ac9c-8bfa50138be1 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.136937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd6b3-713c-4f28-b916-e84af6e32dc5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.145222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.146175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.146175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.146435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.147225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] RBAC: Adding query filter params (interface=public, service_id=2726a7bc53e245549022d3b358780aef, region_id=RegionOne) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:39.148425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.150771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.161737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 458/890] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:38 2022] GET /identity/v3/endpoints?service_id=2726a7bc53e245549022d3b358780aef&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:39.162930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.176490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.177742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.178744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.179866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.180431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.181407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:39.181951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.183577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.194114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 433/891] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:39.195421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.275568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845fcf-6b5b-4cca-aabc-34de45e88ba4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.306930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54d046-81d5-4ec3-a0ae-cf0e96a49cc7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.316709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.317385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.317669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.317946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.318646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.320518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0ba9-69ac-42da-bc54-966145b18d8e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.326430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 459/892] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:35:39.327653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815c47-522a-4069-b85d-c57523222889 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.327945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815c47-522a-4069-b85d-c57523222889 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.328225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815c47-522a-4069-b85d-c57523222889 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.329645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 460/893] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:39.335759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.336048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.336333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.349106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.357237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:39.358154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.358480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:39.359256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.359847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.360365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.361296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:39.361807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.363604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.374609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 434/894] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:39.376151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.466188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 461/895] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:39.490188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.495497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.534856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d34319-e381-40d8-9ac4-2dcc45355c4f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.577597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.578350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.578639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.578910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.579817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] RBAC: Adding query filter params (interface=public, service_id=9e3eb52eaee242698f232e4b04e2f184, region_id=RegionOne) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:39.580131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.581513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.589248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 435/896] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/endpoints?service_id=9e3eb52eaee242698f232e4b04e2f184&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:39.595235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.631654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a154-2675-427a-898a-b2b9a0c3a556 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.659974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.667547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.668370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.668651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.668924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.681492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-2ddaf0f7-96b0-4425-9172-d70d599c6ca3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:39.690547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:39.691563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 462/897] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:39.697606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195b13-8897-4d5d-8d59-e325626f8d7f None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.698353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195b13-8897-4d5d-8d59-e325626f8d7f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.698353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195b13-8897-4d5d-8d59-e325626f8d7f None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.698353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 463/898] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:39.700396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3195b13-8897-4d5d-8d59-e325626f8d7f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.711908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0d823-dee6-4402-8f35-ca3e7aa8abeb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.753127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.753876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.754259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.754636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.755333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.757605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba2fd9-29cd-487c-b3b6-7a71eca376a5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.771479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 436/899] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:35:39.771479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.771479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.771479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.779050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:39.790950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:39.792222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:39.826431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3195b13-8897-4d5d-8d59-e325626f8d7f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:39.884232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 437/900] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:39.888035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:39.888811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:39.889101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:39.889379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:39.890189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:39.890507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:39.892649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:39.906737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 464/901] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:39.912895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.913116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:39.974483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:40.045901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7de7-4eff-41dc-a0d6-db7c60718986 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.050757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478e94b-bdea-4d5d-b21f-420a24da99b4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.075910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:40.084509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.086933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.087326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.088031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.095414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.096865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.097323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.097745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.099117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.101337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.101781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.103056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:40.127500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:40.128430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:40.129291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:40.129291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:40.129291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:40.129291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:40.129641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 438/903] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:39 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:40.132848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 465/903] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:40.133809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:40.267237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423c9a-ff21-4948-9f64-a80afc14748e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.278149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:40.308728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.309322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.309605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.311313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.311313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:40.311313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.312307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.325459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 439/904] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:40.331319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:40.443976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924ad5-6ab5-4965-b10e-7e315cf91f9e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.483721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.484541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.484819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.485090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.494215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.495706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:40.511462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:40.512459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:40.513394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 466/905] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:40.518700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:40.635105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34901d50-1acf-4c35-b7c9-f4717083b8d9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.670771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.671838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.672357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.672857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.673915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:40.674478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.676146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.695313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 440/906] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:40.700599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:40.747270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:40.809581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf63ba-7f7b-4962-a061-a49b879d81eb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:40.848628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:40.849281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:40.849567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:40.849847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:40.921512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:40.922889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:40.964134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.032107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 467/907] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:41.037447 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.066840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.144938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40512552-aa88-49bd-a7cc-440685b26c03 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.185860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.186892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.187331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.187773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.199383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.201039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:41.219641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:41.220740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:41.221836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:41.221836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:41.221836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:41.221836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:41.223761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 441/908] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:41.229323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.337022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade86ff-ddb3-4a82-b8d7-b84ab23fe7b0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.373984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.374675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.374960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.375231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.375991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:41.376294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.377652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304b2fa-0deb-4df6-a063-c675dfbd5d27 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.385060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.391612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 468/909] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:41.397074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.486739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.502311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69ef7-4ab8-4504-b683-571610608078 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.503296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69ef7-4ab8-4504-b683-571610608078 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.503814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69ef7-4ab8-4504-b683-571610608078 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.505670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 469/910] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:41.509687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996350-3750-4c77-9c4d-768c15f33869 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.511257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.511795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.513062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.538296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:41.540615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:41.557193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.558109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.558465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.558814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.566802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.568494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:41.584179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:41.585801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:41.586757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 442/911] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:41.592901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.631533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 470/912] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:41.653920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.706100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71cb7-42b6-400d-9d37-710c55d742bb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.747769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.748785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.749077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.749360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.750165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:41.750840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.752776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.762315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.771098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 443/913] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:41.779840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.781739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49dff-8faa-4d62-a369-c9774ce03726 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.818640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:41.832540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.834126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.834833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.835926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.837050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.839005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:41.856907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:41.857870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 14:35:41.858724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:41.860988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 471/914] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:41.867897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:41.894655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe301b11-f3c9-4fff-9204-a5a5452afd07 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:41.930294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:41.931207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:41.931700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:41.932122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:41.933112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] RBAC: Adding query filter params (role.id=c43d0f90b816474ab8cff581f581185b, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=b698cb9f41704c67aeb2c667b7a7324e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:41.933573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:41.935186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9823e4-cb04-4a40-adf4-287070b1fd84 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:41.951743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 444/915] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/role_assignments?user.id=b698cb9f41704c67aeb2c667b7a7324e&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=c43d0f90b816474ab8cff581f581185b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:41.989898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24257d-dd8e-4265-9742-d007dd4a52c3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.031371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.032023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.032311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.032593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.033337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:42.033653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.035063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.041014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83092f6-c526-4231-8a31-6e0449c5dfb4 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.041300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83092f6-c526-4231-8a31-6e0449c5dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.041551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 472/916] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:42.041828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83092f6-c526-4231-8a31-6e0449c5dfb4 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.046021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 445/917] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:42.047234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.049157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.049524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.049880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.068710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:42.070674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:42.115656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.135077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.151580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 446/918] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:42.164583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af5db-fa20-47c7-8efb-4ac194e15ae9 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.173531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.201299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.201995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.202268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.202552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.203283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:42.203634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.205057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.211064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 473/919] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:42.216618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.293052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c68c-375e-42ef-b6c4-4369a9b2c2c4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.328938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d20933-de6b-4807-a445-24eff00408f2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.334952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.337381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.338173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.338786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.339985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.341878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.352323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:42.359533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:42.360564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 14:35:42.361378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:42.369653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 447/920] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:42.371438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.378529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.378529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.378946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.378946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.379736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.381142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491cc29-f62b-40db-97a5-b0258904e875 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.407565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 474/921] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:35:42.409126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600e57-c149-4f08-ad69-d9fd299ab950 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.409422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600e57-c149-4f08-ad69-d9fd299ab950 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.409707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600e57-c149-4f08-ad69-d9fd299ab950 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.411471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 475/922] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:42.417871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.418188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.418443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.437262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:42.438512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:42.445481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.506150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261c8d0-487d-4ac6-813c-60f98b1cfbd7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.533459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 476/923] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:42.555098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.558120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.559473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.559925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.560354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.561339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:42.561815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.563403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.574552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 448/924] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:42.576360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.693046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757b94-6cc7-4a80-b8f0-729c2e9dd540 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.695800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.710138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537f638-e39e-484c-be81-3336defe8dc1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.737571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:42.743489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.744540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.745044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.745567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.746377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.748049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.754220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de18f-c64f-4e26-9013-791612394feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.755167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de18f-c64f-4e26-9013-791612394feb None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.755483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de18f-c64f-4e26-9013-791612394feb None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.755759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de18f-c64f-4e26-9013-791612394feb None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.756474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799de18f-c64f-4e26-9013-791612394feb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:42.756782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799de18f-c64f-4e26-9013-791612394feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.758678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799de18f-c64f-4e26-9013-791612394feb None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.768697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 449/925] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:42.768868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:42.769797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:42.771195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 477/926] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:42.774123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de18f-c64f-4e26-9013-791612394feb None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.777996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.897468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799de18f-c64f-4e26-9013-791612394feb None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.911578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ebf3d-7d51-4020-a42c-92f45d501ac1 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:42.935871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.936852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.937316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.937768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.938709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.940557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.951486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:42.952599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:42.953002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:42.953479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:42.954184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:42.954633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:42.956337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:42.971494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 478/928] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:42.971494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:42.971967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 450/928] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:35:43.016233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:43.100441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0b73f-486a-48f4-8982-fa49b9772f7a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:43.146489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:43.147166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:43.147524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:43.147779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:43.148490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:43.148911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:43.150284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:43.155950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 479/929] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:43.161929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:43.208258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:43.271691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9312912-708b-4c4c-bcce-3f285c20a809 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:43.307467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:43.308154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:43.308441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:43.308723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:43.309526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] RBAC: Adding query filter params (interface=public, service_id=c71aff1a40c049c298ac0061d5d136e8, region_id=RegionOne) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:43.309843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:43.311220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eddbde-58ca-4dea-be2f-2aa0952a3b2b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:43.316962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 451/930] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:43 2022] GET /identity/v3/endpoints?service_id=c71aff1a40c049c298ac0061d5d136e8&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:43.322877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:43.424527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:43.435127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591f793-0c07-48bd-9f86-cbfbe2b2b358 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:43.470150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:43.470819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:43.471102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:43.471378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:43.472100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:43.473469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d9ce-32ea-4c85-9b3d-aaa60c485446 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:43.480698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 480/931] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:43 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:35:44.127484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf2b-2696-4def-b2e6-252fce878e7e None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.128036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf2b-2696-4def-b2e6-252fce878e7e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.128036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bdf2b-2696-4def-b2e6-252fce878e7e None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.129654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 452/932] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:44.135247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249545df-1241-49be-94f6-0a400333efea None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.135687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249545df-1241-49be-94f6-0a400333efea None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.135860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249545df-1241-49be-94f6-0a400333efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.153018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-249545df-1241-49be-94f6-0a400333efea None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:44.154200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-249545df-1241-49be-94f6-0a400333efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:44.228954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 481/933] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:44.252518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bdf2b-2696-4def-b2e6-252fce878e7e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.361886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bdf2b-2696-4def-b2e6-252fce878e7e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:44.364598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:44.397382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:44.398150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.398434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.398713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.409148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:44.417831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:44.418742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:44.419594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 453/934] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:44.424996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249545df-1241-49be-94f6-0a400333efea None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.518879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:44.537006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249545df-1241-49be-94f6-0a400333efea None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:44.574569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:44.575284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.575600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.575875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.576637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:44.576946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:44.578319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540e45-039d-44fa-aefb-9e5a8f21bc29 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:44.587711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 482/935] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:44.593687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.639097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a450-6bbe-452f-ba29-4a6c1a255dc4 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.639828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a450-6bbe-452f-ba29-4a6c1a255dc4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.640178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150a450-6bbe-452f-ba29-4a6c1a255dc4 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.642037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 483/936] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:44.648330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.648907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.649406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.668335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:44.669953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:44.712244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9ad87-0e71-4849-9309-1e9767ff0683 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:44.750948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:44.751382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 484/937] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:44.752401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.752953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.753369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.765855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:44.767685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:44.769829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:44.790915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:44.792074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:44.793138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:44.793138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:44.793138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:44.793138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:44.799726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 454/938] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:44.802257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.828497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:44.865218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:44.896605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3b92-13b0-45f6-a0c6-5e6beb5236fe None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:44.926168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37f85-44cc-458a-ab6a-cef97274dc53 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:44.942114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:44.943795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.944223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.945445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.946438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:44.948243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:44.964487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:44.965684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:44.966672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:44.967792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:44.968560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:44.968955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:44.969440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:44.969846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 485/939] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:44.974957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:44.975355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:44.976103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:44.976992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:44.996883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 455/940] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:44.998127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.093455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43f85-c531-4735-8b65-50a58abe6892 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.097001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.128615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5ab6-8c0c-4515-9973-77f6466879dd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.134483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.135284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.135819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.136057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.136891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] RBAC: Adding query filter params (name=compute) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:45.137346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.138871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.149442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 486/941] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:45.150468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.154776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.174161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.175567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.176032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.176513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.187264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.189147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:45.209060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:45.210914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:45.212013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:45.213089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 456/942] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:45.225318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.280465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c7c8d-73f9-42f2-bc2f-9af11bfbbecb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.316081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.316756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.317045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.317327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.318052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:45.318366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.320486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c09e7-e633-4aaf-b3d3-a24c30e963c5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 487/943] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3686-3d4e-424d-99ac-6b7af53d846e None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3686-3d4e-424d-99ac-6b7af53d846e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3686-3d4e-424d-99ac-6b7af53d846e None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 488/944] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805209b-f7b3-415e-8688-986354b2854b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.335481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805209b-f7b3-415e-8688-986354b2854b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.336143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805209b-f7b3-415e-8688-986354b2854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.347628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788dbbb-3b76-468b-9378-5846050cc886 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.360047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d805209b-f7b3-415e-8688-986354b2854b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:45.362144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d805209b-f7b3-415e-8688-986354b2854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:45.392207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.393106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.393475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.393857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.394806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:45.395193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.396813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.401467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.418450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 457/945] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:45.424232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.458197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.469017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 489/946] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:45.494958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805209b-f7b3-415e-8688-986354b2854b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.569413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa0a5-7d5c-453c-a70d-08f12f15e5ef None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.606809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.607699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.608044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.608331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.621160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.622596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.630884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805209b-f7b3-415e-8688-986354b2854b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-1acdaf9f-e72f-439e-9219-d831cb52c79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:45.641868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:45.642902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:45.643932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:45.643932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:45.643932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:45.643932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:45.648559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 458/947] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:45.650030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4a66-c4dc-443e-a43f-87c2ecb1f933 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.650320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4a66-c4dc-443e-a43f-87c2ecb1f933 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.650603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4a66-c4dc-443e-a43f-87c2ecb1f933 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.652179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 459/948] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:45.652909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b4a66-c4dc-443e-a43f-87c2ecb1f933 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.680921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.681670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.681974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.682243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.682965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.684434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.685926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING keystone.server.flask.common [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 14:35:45.706485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.sql.core [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 14:35:45.706485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 14:35:45.706485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [parameters: {'id': '24fb67f152044f19864fdde0ca1ee2c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 14:35:45.706485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92083) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 14:35:45.710376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-9156bfdd-24ba-4edc-8357-9694f63585e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 24fb67f152044f19864fdde0ca1ee2c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 24fb67f152044f19864fdde0ca1ee2c9. Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:35:45.724386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result.read() Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 14:35:45.725490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application yield resource Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise self.value Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application session.commit() Jul 20 14:35:45.726510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.session.flush() Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application compat.raise_( Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 14:35:45.727385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 14:35:45.728313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result.read() Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:35:45.729105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [parameters: {'id': '24fb67f152044f19864fdde0ca1ee2c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.731822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:45.734189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 24fb67f152044f19864fdde0ca1ee2c9. Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 490/949] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Jul 20 14:35:45 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.738295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.740797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.748595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:45.750152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:45.787600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b4a66-c4dc-443e-a43f-87c2ecb1f933 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.813589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.830079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.831060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:45.831586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:45.832045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:45.832996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:45.833485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 491/950] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:45.833651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:45.834437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.835840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:45.863736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 460/951] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:45.864952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:45.960128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e75639-debd-40dc-bd49-463844ddcb5b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.975175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12bf7a-1625-42c9-8ad9-76432ab8b057 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:45.984070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:45.998621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:45.999899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.000185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.000610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.007746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.009420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.014499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.015604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.016108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.016585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.017491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.019069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:46.024052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:46.024955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:46.025845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 492/952] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:46.026336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:46.035377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:46.036441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:46.037699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:46.045905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 461/953] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:46.045905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.081198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:46.148520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3435007-1f0c-4088-b221-737bf83f21d5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.157192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c34d6-69df-4325-95a1-d189892ed5d2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.186109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.187030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.187410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.187729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.193342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.194092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.194366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.194554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.195637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.195925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:46.196229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.197085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.197839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:46.211484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:46.212459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 493/954] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:46.213439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.219916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 462/955] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:46.221032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.274543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:46.349972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db320909-f8ca-4ae3-a344-4a126fdf7e28 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.354272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:46.375712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66266-cd13-45af-9156-8bb8435e2268 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.403518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.404847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.405348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.406597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.407968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:46.408818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.410641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.420396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.421069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.421350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.421624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.422219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 494/956] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:46.423509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:46.423789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.425238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.428292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.441520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 463/957] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:46.448660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.556551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:46.566132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70768-3e9b-43a9-b4ae-3b241372dcd2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.566676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4b026-766e-43d8-9a18-d358b038c426 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.603751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.604647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.604975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.605252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/b698cb9f41704c67aeb2c667b7a7324e/roles/c43d0f90b816474ab8cff581f581185b` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.606613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.607587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=b698cb9f41704c67aeb2c667b7a7324e, role_id=c43d0f90b816474ab8cff581f581185b)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.607714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.608228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.608703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.609018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0c918-83a7-40a6-8f81-7c6d9fa2996b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.609816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:46.610327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.612152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.618637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 495/958] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:46.624389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:46.631498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 464/959] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:35:46 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/b698cb9f41704c67aeb2c667b7a7324e/roles/c43d0f90b816474ab8cff581f581185b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:35:46.666380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:46.747745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c25a-0787-44b1-a860-c80ff093b0ed None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:46.790958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:46.791644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:46.791932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:46.792256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:46.793026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:46.794409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5db251-700f-4957-b971-d6c29bff493c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:46.817760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 496/960] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:47.470021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd985-614c-4a14-84c1-72e9e628b996 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:47.471049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd985-614c-4a14-84c1-72e9e628b996 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:47.471599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fd985-614c-4a14-84c1-72e9e628b996 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:47.473657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 465/961] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:47.480569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1248-611b-439c-917c-61d8517898d5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:47.481541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1248-611b-439c-917c-61d8517898d5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:47.482015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1248-611b-439c-917c-61d8517898d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:47.500287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0efd1248-611b-439c-917c-61d8517898d5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:47.501794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0efd1248-611b-439c-917c-61d8517898d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:47.583564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 497/962] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:47.601295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fd985-614c-4a14-84c1-72e9e628b996 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:47.713440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fd985-614c-4a14-84c1-72e9e628b996 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:47.748487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:47.749083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:47.749370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:47.749652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:47.750396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:47.751781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3cad-0264-49fa-a3cd-ca0205d8a53b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:47.767705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 466/963] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:47 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:48.460012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88921-146c-49c7-8464-b958236723cd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.460746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88921-146c-49c7-8464-b958236723cd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.461265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88921-146c-49c7-8464-b958236723cd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.463141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 498/964] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:48.468725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.469323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.469829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.487301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:48.489570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:48.493376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:48.584710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 467/965] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:48.609741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88921-146c-49c7-8464-b958236723cd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:48.626785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:48.724197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88921-146c-49c7-8464-b958236723cd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:48.762630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:48.763314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.763634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.763915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.764647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:48.766235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:48.780931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.sql.core [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 14:35:48.780931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 14:35:48.780931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [parameters: {'user_id': '89b035cc34b94647a892898807c5b8a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 14:35:48.780931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92083) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-53b85f2f-d13b-4152-bfe2-b634a67c66ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result.read() Jul 20 14:35:48.789740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:35:48.790626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application yield resource Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application next(self.gen) Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise self.value Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application session.commit() Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 14:35:48.791847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.session.flush() Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application compat.raise_( Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 14:35:48.793275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 14:35:48.794360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application conn.query(q) Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application result.read() Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 14:35:48.795380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [parameters: {'user_id': '89b035cc34b94647a892898807c5b8a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:48.796525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 14:35:48.797327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:48.798300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 499/966] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Jul 20 14:35:48 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:48.798691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:48.825268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0f62-741b-4ac2-a357-3f2420624eb6 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.825561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0f62-741b-4ac2-a357-3f2420624eb6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.825846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0f62-741b-4ac2-a357-3f2420624eb6 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.830155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 500/967] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:48.835505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.835804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.836113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.857405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:48.858935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:48.925488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5a33-0d09-4e25-ab93-b325835e134d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:48.935262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 501/968] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:48.958686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:48.967626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:48.968807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:48.969317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:48.969802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:48.973853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:48.976034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:48.980924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:48.982409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-c52954a0-9fdb-43ce-b218-5aa291798767 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:48.999531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:49.000546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:49.001473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 468/969] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:35:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:49.002065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cfd82-0594-42ef-8a29-b7e6caa83137 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.002455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cfd82-0594-42ef-8a29-b7e6caa83137 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.003182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cfd82-0594-42ef-8a29-b7e6caa83137 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.004682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 469/970] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:49.009126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cfd82-0594-42ef-8a29-b7e6caa83137 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.093863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7afe-267a-414d-a5c5-4f244d816ff9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.122821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cfd82-0594-42ef-8a29-b7e6caa83137 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.129419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.130242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.130527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.130812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.142820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-763a21fc-2a71-4dde-bece-60ad783edac4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:49.151112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:49.152267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:49.153101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 502/971] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:35:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:49.153809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.154565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.154565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.164992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.165675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.165963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.166497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.167199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.167541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.168994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.171913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:49.173111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:49.214246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 470/972] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:49.214246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.248989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.259390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 503/973] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:49.283118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.283799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.353876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4593-8bd8-46df-b14b-ac0a8fd75cb6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.402713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.403412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.403738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.404023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.404676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5a38-5b2c-4250-9d0b-3c65fc1ddd28 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.404786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.405102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.406793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.430991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 471/974] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:49.432578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.457445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.458097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.458383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.458665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.459339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.461494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:49.475264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:49.476643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:49.477677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:49.481739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 504/975] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:49.483103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.553305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66918c-e4d4-42e3-b571-4905abc4649c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.557386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.574226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.594695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.595526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.595807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.596082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.604583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9365-50c4-4779-81a1-8066bcf07417 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.608080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.609562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:49.628957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:49.629903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:49.630787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:49.630787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:49.630787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:49.630787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:49.630787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 472/976] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:49.636588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.646164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.647387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.647697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.648032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.649235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.649546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.650911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.656594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 505/977] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:49.662129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.754959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01698de0-7c02-41f3-a90a-34033f9f2d7c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.786400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ab1c-2901-4c95-8360-01433318a799 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.796722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.797694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.797991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.798291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.799175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.799515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.801256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.812122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.817798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 473/978] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:49.818595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.825679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.826352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.826642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.826922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.827671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.827985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.829364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.834436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 506/979] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:49.840737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:49.860822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:49.944917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311f611-a677-463b-be7d-910a48ea843c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.961731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb352f-bb50-415d-a64a-d36728984180 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:49.980212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.981031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.981320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.981599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.989421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:49.990864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:49.996782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:49.997450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:49.997733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:49.998013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:49.998859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] RBAC: Adding query filter params (interface=admin, service_id=c71aff1a40c049c298ac0061d5d136e8, region_id=RegionOne) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:49.999179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.000657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49762c-54c9-47fc-aa77-ed09f95a0216 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:50.005715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:50.006766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 14:35:50.012577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:50.013136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 507/980] 10.222.0.23 () {56 vars in 1249 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/endpoints?service_id=c71aff1a40c049c298ac0061d5d136e8&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:50.013136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bb40-4547-4445-89f3-3dd5177caf99 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.013263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 474/981] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:35:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:50.013328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bb40-4547-4445-89f3-3dd5177caf99 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.013328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31bb40-4547-4445-89f3-3dd5177caf99 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.013328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 508/982] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:50.013517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.013584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31bb40-4547-4445-89f3-3dd5177caf99 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.073789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.121173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.135382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31bb40-4547-4445-89f3-3dd5177caf99 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.137290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bb406-2cd4-4492-a993-65dec947b3c6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.174454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.175133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.175420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.175733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.175990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.176432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.176663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.176946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.177224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.177816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71071c70-cff2-4bb7-8aac-cf0ab19798a8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.178071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:50.178397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.180374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.184216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 475/983] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:35:50.185516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.185815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.186096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.200689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 509/984] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:50.204462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:50.206154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:50.206450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.286062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 476/985] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:50.310912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.337200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b801c3f-d934-4079-992a-4ccf23c94550 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.349518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.378148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.378807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.379096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.379378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.407570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.427499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4085a1-dd10-4da1-8bce-2bce9d825f8d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.469099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.469908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.470186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.470461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] PATH_INFO: `/v3/services/compute` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.470640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.471134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.472214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.472515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:50.487067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:50.488365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:50.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 477/986] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:50.495947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.599588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 510/987] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 14:35:50.600941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.614453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3cc7-3b26-4a1f-8a92-9d319315344b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.615738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.657342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.658031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.658316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.658600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.659322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] RBAC: Adding query filter params (name=compute) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:50.659666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.661052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.667131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 478/988] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:50.672992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.686638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.715038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1d96f-6423-40a2-8be1-268d8cbf41c0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.752036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.752860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.753164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.753442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.764669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.766128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:50.791241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:50.792368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:50.793381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:50.793381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:50.793381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:50.793381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:50.793381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 511/989] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:50.797520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bcf17-791c-402f-8f8e-0968467a832b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.797937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.833221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.833898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.834184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.834463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.835315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:50.836901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.838909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.845122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 479/990] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:50.850944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:50.868738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.912680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74138df-7ecb-4f8e-8ee3-f0caf65c9740 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.937375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:50.950563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:50.951233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:50.951553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:50.951849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:50.953119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:50.953439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:50.954823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:50.965793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7d305-28c7-49ad-9f34-d64e5ed32d61 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:50.968642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 512/991] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:50.973907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:51.008963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:51.009628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:51.009919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:51.010190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:51.010998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] RBAC: Adding query filter params (interface=public, service_id=28636b5dba3b43488611c25dcd39f0dc, region_id=RegionOne) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:51.011309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:51.012717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:51.018148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 480/992] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/endpoints?service_id=28636b5dba3b43488611c25dcd39f0dc&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:51.024001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:51.079751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a51a2-737e-421b-a5b9-67750583e4fa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:51.102843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:51.116122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:51.116950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:51.117242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:51.117524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:51.124318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:51.125739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:51.137717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3e5f-69f5-4371-a987-9f48d23ca24e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:51.140639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:51.141516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:51.142835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 513/993] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:51.147491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:51.176795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:51.177732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:51.178170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:51.178585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:51.179962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:51.181564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:51.189133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 481/994] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:51 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:35:51.274460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695473f-7577-4d50-87d9-f70c5e1b2480 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:51.314332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:51.315007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:51.315290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:51.315601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:51.316515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:51.316830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:51.318329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef64ad-633e-4b0d-89c4-bd437c78d6d4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:51.338166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 514/995] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:51.339277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:51.342301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:51.452534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89a26d-dd45-4edb-81bf-4777ad16e5ac None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:51.493174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:51.494172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:51.494693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:51.495435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:51.497368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] RBAC: Adding query filter params (role.id=c43d0f90b816474ab8cff581f581185b, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=b698cb9f41704c67aeb2c667b7a7324e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:51.498086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:51.499722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9345e2-7d8f-409e-8697-fd8611a4c3d7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:51.506647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 482/996] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:51 2022] GET /identity/v3/role_assignments?user.id=b698cb9f41704c67aeb2c667b7a7324e&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=c43d0f90b816474ab8cff581f581185b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:52.266362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467839-7e95-4a12-9590-0356b9f00020 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:52.266886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467839-7e95-4a12-9590-0356b9f00020 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:52.266886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467839-7e95-4a12-9590-0356b9f00020 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:52.268441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 515/997] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:52.274141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:52.274581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:52.274693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:52.291899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:52.293076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:52.358204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:52.367676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 483/998] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:52.391081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467839-7e95-4a12-9590-0356b9f00020 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:52.438750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:52.499139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467839-7e95-4a12-9590-0356b9f00020 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:52.540548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:52.541352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:52.541631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:52.541904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:52.542559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:52.543951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:52.556082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:52.557063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:52.557943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 516/999] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Jul 20 14:35:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:52.564868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:52.673855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35a92-e76f-49ae-a331-93acf8905e5e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:52.709732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:52.710413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:52.710798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:52.711017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:52.711770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:52.712086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:52.713461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:52.723043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 484/1000] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:52.724621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:52.831231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4e8f-8d65-42b7-96e0-c6fa2bd3d9bc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:52.840874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:52.875336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:52.876338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:52.876902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:52.877360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:52.878259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:52.878745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:52.880321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a0ed0-bc55-427a-8ee3-e20fc4f8fcc5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:52.889414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 517/1001] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Jul 20 14:35:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:52.895296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:52.960526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:53.005739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896702a-231c-4d94-b082-ee15902d84e0 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:53.044109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:53.044791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.045081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.045362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.046130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:53.047519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a45d6-31a8-423b-893f-4d449e7ba5d4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:53.071489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 485/1002] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:53.295930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9549c-446e-4dc2-8ec4-6e8d6ed3bf44 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.296523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9549c-446e-4dc2-8ec4-6e8d6ed3bf44 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.296523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9549c-446e-4dc2-8ec4-6e8d6ed3bf44 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.298006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 518/1003] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:53.303129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.303584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.303734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.321019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:53.322209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:53.397220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 486/1004] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:53.420971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9549c-446e-4dc2-8ec4-6e8d6ed3bf44 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:53.536629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9549c-446e-4dc2-8ec4-6e8d6ed3bf44 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:53.574027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:53.574791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.575066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.575348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.576076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:53.577458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-daff61bf-f74e-4e47-80de-2077f4bcac90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:53.590011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:53.591030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.597174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 519/1005] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:53.599624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:53.600569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ee85-3502-467f-a743-4dddce1948fb None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.600863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ee85-3502-467f-a743-4dddce1948fb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.601146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0ee85-3502-467f-a743-4dddce1948fb None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.602869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 520/1006] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:53.607567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.607856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.608135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.625439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:53.626649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:53.654436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:53.658985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:53.704038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 521/1007] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:53.716115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a459f-e1da-41a9-8b05-0aac0f70f8df None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:53.725801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:53.756149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:53.756814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.757114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.757388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.758681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:53.758997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:53.760668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:53.770309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 487/1008] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:53.771329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:53.836226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbb69b-b6a6-49e1-9f89-224b15610389 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:53.876105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:53.876317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0457-ba84-472a-9f5c-b8bce6512835 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:53.876899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.877178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.877446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] PATH_INFO: `/v3/services/image` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.878108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:53.879514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:53.887966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:53.891731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:53.892735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:53.893593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 522/1009] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Jul 20 14:35:53 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:53.898859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:53.917882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:53.918553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:53.918837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:53.919112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:53.919853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:53.920160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:53.921524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:53.926772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 488/1010] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Jul 20 14:35:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:53.930376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:53.933272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:54.011258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de520-e8cb-4e7a-8a82-a78c1483590d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:54.046471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11299-b803-42db-afe6-20bfe9086c85 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:54.047506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:54.048180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:54.048468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:54.049439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:54.049439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] RBAC: Adding query filter params (name=image) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:54.049765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:54.051145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:54.061834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 523/1011] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:54.062951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:54.094567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:54.095204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:54.095435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:54.095758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:54.096503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:54.097870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296af60d-0323-484f-9c3f-9b9bbac83e70 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:54.123980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 489/1012] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:35:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:54.168659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:54.181360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a3e2-3641-4ebb-992f-3698bd37381f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:54.230789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:54.231585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:54.231877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:54.232159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:54.233007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] RBAC: Adding query filter params (type=image) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:54.233327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:54.234773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe4bc-1cba-458a-9c2d-5ab7f0be9e08 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:54.240901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 524/1013] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:55.181090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012d4e4-bf14-4b0d-bd8e-2db59e2a473a None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:55.181653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012d4e4-bf14-4b0d-bd8e-2db59e2a473a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:55.181653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012d4e4-bf14-4b0d-bd8e-2db59e2a473a None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:55.183762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 490/1014] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:55.189307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:55.189715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:55.189882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:55.206676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:55.207907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:55.277060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 525/1015] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:35:55.300420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012d4e4-bf14-4b0d-bd8e-2db59e2a473a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:55.335076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:55.417005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012d4e4-bf14-4b0d-bd8e-2db59e2a473a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:55.452251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:55.453056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:55.453343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:55.453623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:55.454806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:55.456267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4789a-8e67-4d8c-bd0b-92429579161b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:55.458085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 491/1016] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:55.464501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:55.558116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:55.577864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0dd0b-3a07-4c72-96ad-0e38e8dfc8dc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:55.614042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:55.614957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:55.615244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:55.615551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:55.616269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:55.617704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c7dc-627f-4574-8815-45372298baf2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:55.651496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 526/1017] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:55 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:56.307296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd0a3-81cd-4225-a197-647a1850c152 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.307901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd0a3-81cd-4225-a197-647a1850c152 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.307901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dd0a3-81cd-4225-a197-647a1850c152 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.309415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 492/1018] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:56.311797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2548f9f-77bc-48b7-ba1c-d4c33efb4434 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.312178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2548f9f-77bc-48b7-ba1c-d4c33efb4434 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.312381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2548f9f-77bc-48b7-ba1c-d4c33efb4434 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.314196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.314488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.314771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.315415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 527/1019] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:56.320292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.320578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.320859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.332640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:56.333836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:56.337872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:56.339040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:56.405571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 493/1020] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:56.409777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 528/1021] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:56.428517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:56.433218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:56.460407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:56.506015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:56.552939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780530c0-f403-43d1-aed5-58e7ed8e37e7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:56.553599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189e8c-a538-40bb-b1c1-916db4d53eb6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:56.589789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:56.590525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.590812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.591089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.591672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:56.592344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.592634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.592915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.593656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:56.595026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:56.602639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:35:56.609577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 494/1022] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:35:56 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:35:56.610945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:56.611915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:35:56.612798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:56.618024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 529/1023] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:35:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:35:56.619585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:56.720630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:56.743833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cb210-b77a-43ba-ad85-ce041000528a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:56.782514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:56.783203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.783524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.783806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.784570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:56.784875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:56.786275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:56.798051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 495/1024] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:35:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:56.805474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:56.912658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93c63e-28ed-48a0-89b4-8a6851fc2bb5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:56.944854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:56.956414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:56.957218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:56.957500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:56.957774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:56.969323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:56.970777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:56.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:56.990036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:56.990949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:56.990949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:56.990949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:56.990949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:56.990949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 530/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:56.996413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.099181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ba17-fbca-4510-a028-0e1e7e86c9de None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:57.135793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:57.136459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.136740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.137015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.137751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:57.138055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:57.139505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:57.156004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 496/1026] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:57.157426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.265206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4a130-2f19-4dbe-9e4f-9f11b81d2101 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:57.301547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:57.302348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.302643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.302923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.311758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:57.313296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:35:57.328424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:57.329362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:35:57.330310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:57.331806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 531/1027] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:35:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:57.335330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.345326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:57.443791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874a9d-6de3-42fd-be6d-b4c1c7fc5ec1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:57.478486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:57.479163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.479471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.479841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.480688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:57.480999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:57.482425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea757786-ce29-4909-a966-8422f7c81769 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:57.506253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 497/1028] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:35:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:57.507481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.553129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:57.622582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbcd2d-e401-4e38-82ff-cab6f96ce904 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:57.655986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:57.656644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.656927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.657203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.725900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:57.727921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:57.747674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f41b3-a1ba-4860-9c9f-523bc0b81262 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.747969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f41b3-a1ba-4860-9c9f-523bc0b81262 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.748260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f41b3-a1ba-4860-9c9f-523bc0b81262 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.749625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 498/1029] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:35:57.755013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:57.755309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:57.755639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:57.767332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:57.773616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:57.774871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:57.835991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:57.843828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 532/1030] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:35:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:35:57.845720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 499/1031] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:57.853017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.872179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:57.981379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f08bc9-4e6f-4709-b64d-18a731badda2 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.001408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a38b2c-06e8-43f6-b659-7f70cef84980 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.019932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.020720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.020999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.021272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.024533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:58.032620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.034050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.041053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.041970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.042258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.042536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.043881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.045307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.051511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 500/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:35:58.052190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:58.053054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:58.053973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:35:58.053973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:35:58.053973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:35:58.053973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:35:58.054205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.054283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 533/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:58.060276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.118141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:58.158788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b06f5-18c7-405f-970d-8a9e2893d0ae None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.173323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba388b-c116-4dfd-a400-0bb89f684a3e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.197851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.198531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.198818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.199097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.199866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.201289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.214224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.214893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.215167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.215439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.216199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:58.216515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.217895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.231483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 501/1034] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:35:58 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:35:58.238548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 534/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:58.245575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.361423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b48e0-1b66-475d-b6ad-db4237e6747f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.380876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:58.402042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.402852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.403133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.403409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.410545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.412046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:35:58.427285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:58.428411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:58.429497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 502/1036] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:58.435306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.492986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:58.550004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0abc9-81fd-46d7-82f4-d82f70caff91 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.586569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.587249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.587566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.587851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.588659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:58.588977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.590432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1a71-7eea-4e84-bb88-ab0dc04f21dc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.603350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 535/1037] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:58.609324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.714962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae9b8-bc4c-4813-9ad9-6ad55d93983f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:58.734401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb3d48-fbc1-48b5-8eef-e687361d4e12 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.734730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb3d48-fbc1-48b5-8eef-e687361d4e12 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.734962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb3d48-fbc1-48b5-8eef-e687361d4e12 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.736503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 536/1038] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:35:58.741627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.741889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.742703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.750742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:58.751409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:58.751728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:58.752003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:58.752868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] RBAC: Adding query filter params (role.id=c43d0f90b816474ab8cff581f581185b, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:58.753172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:58.754677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:58.759851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:35:58.761056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:35:58.766546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 503/1039] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:35:58 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=c43d0f90b816474ab8cff581f581185b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:58.840602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 537/1040] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:35:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:35:58.863495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:58.912929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:58.972898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfa7f-332b-46a6-91c3-98c1bada67c5 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:59.006825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:59.007649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:59.008494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:59.008772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:59.009442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:59.010820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:35:59.024926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:35:59.025972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:35:59.026824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:35:59.028363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 504/1041] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Jul 20 14:35:58 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:35:59.032171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:59.074291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:59.138791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7b0cc-5007-4273-89db-0c576c8d3853 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:59.174501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:59.175177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:59.175477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:59.175775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:59.176500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] RBAC: Adding query filter params (name=image) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:59.176816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:59.178194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:59.184062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 538/1042] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:59.189565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:59.296095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357828b3-af1f-4016-af89-26756fb4f3c7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:59.303215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:59.332035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:59.332705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:59.332989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:59.333266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:59.333978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] RBAC: Adding query filter params (type=image) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:59.334287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:59.335684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:59.345302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 505/1043] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:35:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:35:59.346550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:59.458732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e423-4ff1-4ddb-9c9f-ae32d85cddf6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:59.460432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:35:59.499346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:59.500034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:59.500316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:59.500588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:59.501390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] RBAC: Adding query filter params (interface=public, service_id=12a0845cf20044218921b1a625d96343, region_id=RegionOne) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:35:59.501700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:59.503156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4e725-b66c-4e3d-a882-88599814ec31 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:59.513716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 539/1044] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:35:59 2022] GET /identity/v3/endpoints?service_id=12a0845cf20044218921b1a625d96343&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:35:59.515177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:35:59.636210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6357c8-ddbf-4e54-8619-2c5aa2e79585 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:35:59.671234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:35:59.671939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:35:59.672336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:35:59.672529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:35:59.673189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:35:59.674555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764419-d6f5-41e0-aec2-8f51975dd419 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:35:59.681941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 506/1045] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:35:59 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:36:00.392112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3386-d017-4036-8079-dfce99438b59 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.392499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3386-d017-4036-8079-dfce99438b59 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.392698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3386-d017-4036-8079-dfce99438b59 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.394194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 540/1046] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:00.399362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.399684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.399965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.417055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:00.418245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:00.447807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:00.489857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 507/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:00.515007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e3386-d017-4036-8079-dfce99438b59 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:00.642589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e3386-d017-4036-8079-dfce99438b59 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:00.677931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:00.679038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.679523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.680742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.692210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-4ef76e51-a23d-46cd-9d73-4aed04e0d6f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:00.700343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:00.701286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:00.702134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:00.704610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 541/1048] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:00.710360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:00.822108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba613-6ab5-48cd-8b62-53f83f6073dd None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:00.840519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6221-c903-4f5d-b366-e69b6fe4cb68 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.840905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6221-c903-4f5d-b366-e69b6fe4cb68 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.841086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6221-c903-4f5d-b366-e69b6fe4cb68 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.842595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 542/1049] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:36:00.847863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.848154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.848439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.861978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:00.862967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:00.863253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:00.863559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:00.864321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:00.864626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:00.866275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:00.869193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:00.870890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:00.876114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 508/1050] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:00.881707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:00.894638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:00.912205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:00.947495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 543/1051] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:00.971164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.002145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64cba-8f12-492f-85a4-159bc256ed88 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.038693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.040218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.040508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.040785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] PATH_INFO: `/v3/users/15d80e7a002c4384bc063ef0f8e71441` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.054737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] RBAC: Authorizing `identity:get_user(user_id=15d80e7a002c4384bc063ef0f8e71441)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.056507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.063024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 509/1052] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:00 2022] GET /identity/v3/users/15d80e7a002c4384bc063ef0f8e71441 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:01.064091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.080550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60247669-5fed-4aa7-a608-20a07ebbabcd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.118527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.119351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.119671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.120012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.130966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:01.139643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:01.140620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:36:01.141544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:01.146106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 544/1053] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:36:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:01.146778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.153941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.167595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.174066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba268c70-8368-413c-8d9a-8e4be508af0a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.210143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.210810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.211650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.211933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.261673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848ee96-6e42-4fd8-a597-167ded6f3602 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.288384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.290517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.300401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.301076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.301368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.301657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.302429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:01.302742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.304165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.318570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 545/1054] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:01.319275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.382704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.404265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 510/1055] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 14:36:01.409743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.412256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.437240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d3feb-27a3-4acb-8dbb-d1bc36e7816f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.490100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.491653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.492131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.492675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.510786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.513153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:01.544095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:01.546376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:01.547259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:36:01.547259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:01.547259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:01.547259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:01.547259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 546/1056] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:01.552137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.565099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55a4d-0fca-41db-86d7-d57f8ff205d3 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.603825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.604698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.604976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.605249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.606439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.607911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.614483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 511/1057] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:01.616262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.668504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585720aa-37ae-493b-b71a-c029f099e00f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.683761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.705064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.712895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.713929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.713929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.714192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.714871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:01.715185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.716645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.731779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 547/1058] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:01.737690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.746958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a88f6c-3d31-407b-be81-5d0009edf8a2 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.784187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.784854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.785142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.785426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.786272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde, user.id=15d80e7a002c4384bc063ef0f8e71441) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:01.786598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.788065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0c633-7a2d-4435-a65a-6bbaff210095 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.794383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 512/1059] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/role_assignments?user.id=15d80e7a002c4384bc063ef0f8e71441&scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:01.795677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168fd5-cc48-49f7-bb71-af6fd508c371 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.795966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168fd5-cc48-49f7-bb71-af6fd508c371 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.796242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168fd5-cc48-49f7-bb71-af6fd508c371 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.797606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 513/1060] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:01.803179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.803510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.803850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.823499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:01.824847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:01.848963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68c22-e8ae-4f92-8ab4-684d17196b79 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:01.890234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:01.891533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:01.892163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:01.892639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:01.901144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:01.902623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:01.909890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 514/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:36:01.918937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:01.920163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:01.926129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 548/1062] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:01.928328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.933555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:01.986246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:01.986912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.040592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ee48d-882f-44c5-99cc-232268f6e6b8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.057386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08131e92-9c36-41ba-82a2-6bc227f6c793 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.076037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.076832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.077110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.077378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] PATH_INFO: `/v3/services/image` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.078035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.079396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:02.091107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:02.092214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:02.093411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 549/1063] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:02.097070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.097939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.098102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.098525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.098950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.099989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:02.100472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.103779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.124755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 515/1064] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:36:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:02.130266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.207994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09d73-bffb-4b43-a0d0-39ecadfacf2f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.223120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.236889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a98c7-ba93-452c-88b5-e82eb9200049 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.240110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.248604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.249289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.249935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.250318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.251374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] RBAC: Adding query filter params (name=image) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:02.251838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.253114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.258787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 550/1065] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:02.264671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.277166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.278374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.278938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.279229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.293454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.295733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:02.314804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:02.315950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:02.321592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:36:02.321592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:02.321592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:02.321592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:02.321592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 516/1066] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:02.321936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.382162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365dfc1-ccba-45d5-b86c-3253807b3268 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.419307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.420128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.420416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.421041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.421577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] RBAC: Adding query filter params (type=image) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:02.421888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.423519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.434168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 551/1067] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:02.435194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.446257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af347-081c-4e9a-a61b-a8e85cce97a1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.482426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.488866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.489657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.489821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.490113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.491298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:02.491507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.492847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.505359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 517/1068] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:02.510990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.534788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.550177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278769e-d91c-493f-bada-bcd6191c0089 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.587439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.588150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.588424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.588705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.589472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.590829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.613729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 552/1069] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:36:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:36:02.632371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833f32a-2892-4a56-80cf-dc9a0c62ae01 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.681218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.682036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.682321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.682601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.690479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.692007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:36:02.707940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:02.708981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:02.711018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 518/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:02.715163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.823569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:02.827923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724a2a7-998b-4828-8413-1707cd1aa39e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:02.873109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:02.873769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:02.874048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:02.874376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:02.875179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:02.875519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:02.876988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166bf1-86ce-478f-98cc-ee23806ea46c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:02.891537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 553/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:02.897225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:02.986470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:03.023475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cfd61-c6f8-4bb5-9f70-f355c6cc72f6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:03.061894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:03.062680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:03.062965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:03.063244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/c43d0f90b816474ab8cff581f581185b` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:03.065502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=54774acef6c54a06a81facfe13173568, role_id=c43d0f90b816474ab8cff581f581185b)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:03.067012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394d3d-8432-46fe-8307-d4354803f26a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:03.087570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 519/1072] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:36:02 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/54774acef6c54a06a81facfe13173568/roles/c43d0f90b816474ab8cff581f581185b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:36:03.844451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d858eb2-5500-4464-af12-a2acb6d5d17d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:03.845039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d858eb2-5500-4464-af12-a2acb6d5d17d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:03.845039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d858eb2-5500-4464-af12-a2acb6d5d17d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:03.846535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 554/1073] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:03.852426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:03.852699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:03.852973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:03.870291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:03.871489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:03.943596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 520/1074] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:03.971715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d858eb2-5500-4464-af12-a2acb6d5d17d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.077645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d858eb2-5500-4464-af12-a2acb6d5d17d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:04.111053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:04.111792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.112074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.112344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.123772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:04.131570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:04.132557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:04.134176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:04.135618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 555/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:04.139389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.202187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:04.252493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9b54-8571-4c98-9aae-6f1062498226 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:04.291203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:04.291917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.292209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.292567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.293263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:04.293576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:04.294960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:04.307507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 521/1076] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:04.310901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.330952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:04.415865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7c6a-26d5-4343-acdf-55de087f9702 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:04.459076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:04.460033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.460496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.460844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] PATH_INFO: `/v3/users/15d80e7a002c4384bc063ef0f8e71441` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.462306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] RBAC: Authorizing `identity:get_user(user_id=15d80e7a002c4384bc063ef0f8e71441)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:04.463879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:04.470471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 556/1077] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:04 2022] GET /identity/v3/users/15d80e7a002c4384bc063ef0f8e71441 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:04.471758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.582885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1749b-122c-4d03-9013-c1648bda29f6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:04.609136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:04.622245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:04.623108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.623391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.623701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.625005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:04.626488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109cc03-5242-4858-804b-964d2ae3e242 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:04.633285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 522/1078] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:04 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:04.634534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.725163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:04.739752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02625-bd47-4056-b8b8-4453e9f419c2 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.740861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02625-bd47-4056-b8b8-4453e9f419c2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.741574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02625-bd47-4056-b8b8-4453e9f419c2 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.743151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 523/1079] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:36:04.743272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ce019-35b5-4b6f-baaa-5c05261dfff7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:04.748477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559b54-0279-42d9-a340-ef27758e2f78 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.748760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559b54-0279-42d9-a340-ef27758e2f78 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.749218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559b54-0279-42d9-a340-ef27758e2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.770174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-0e559b54-0279-42d9-a340-ef27758e2f78 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:04.771868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0e559b54-0279-42d9-a340-ef27758e2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:04.779626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:04.780524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:04.780808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:04.781091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde/users/15d80e7a002c4384bc063ef0f8e71441/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:04.783089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] RBAC: Authorizing `identity:create_grant(project_id=48e6532d9ac8456a9031d6f3aeaaafde, user_id=15d80e7a002c4384bc063ef0f8e71441, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:04.784560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:04.799572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 557/1080] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:36:04 2022] PUT /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde/users/15d80e7a002c4384bc063ef0f8e71441/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:36:04.851027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 524/1081] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:04.874595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:04.989600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c5a3-9dcc-40b7-a3dd-b1bf341146af None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.023432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.024643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.024924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.025196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.041743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:05.098766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:05.100350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:05.144163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155c62-3ec2-461b-a5cc-0ccd826137a1 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.144728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155c62-3ec2-461b-a5cc-0ccd826137a1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.144728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155c62-3ec2-461b-a5cc-0ccd826137a1 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.146249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 525/1082] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:05.152174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.152592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.152967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.172686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:05.174350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:05.207687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 558/1083] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:05.214707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.246838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 526/1084] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:36:05.271779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.278164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:05.334258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:05.342318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a728a5-9c46-4274-93b1-0842c472e780 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.380018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.380814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.381100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.381719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.391025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb690acd-1ac6-4014-8ad0-879886bd3483 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.392556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:05.394011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:05.412403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:05.413509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:05.415541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:36:05.415541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:05.415541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:05.415541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:05.415541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 559/1085] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:05.420037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.431110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.432070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.432419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.432762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.444202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:05.452716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:05.453883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 14:36:05.454942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:05.459141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 527/1086] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:05.460022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.537381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:05.542166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7f1b-46e7-499c-85ca-70916ade91fa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.575394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c561c-81aa-40a9-8717-c048b0e4fd51 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.578768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.579434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.579744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.580022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.580824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:05.581070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:05.582443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:05.592348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:05.598968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 560/1087] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:05.630179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.630873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.631172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.631473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.632375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:05.632690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:05.634203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:05.644468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 528/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:05.651602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.780588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e330-288c-4d90-a0b6-e6f54b00aa6a None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:05.816871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:05.817553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:05.817831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:05.818103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:05.830480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:05.832250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:05.852463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:05.853413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:05.854317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:36:05.854317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:05.854317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:05.854317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:05.856007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 561/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:05.861929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:05.970984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940852-4bb9-43b6-8095-d83bd787e862 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.004901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.005574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.005859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.006136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.006866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:06.007176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.009156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:06.022001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 529/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:06.028268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:06.042051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:06.130853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f7b8f-3586-4718-b9b4-bfee65666415 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.164716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.165505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.165788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.166063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] PATH_INFO: `/v3/users/nova` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.173475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.174916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:36:06.189165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:06.190289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 14:36:06.191510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:06.195402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 562/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Jul 20 14:36:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:06.196796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:06.229754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:06.295033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421bca4-6a60-43eb-8c92-deff7e38a89e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.330146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.330815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.331099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.331381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.332255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:06.332573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.334005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:06.350869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 530/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Jul 20 14:36:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:06.356764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:06.426422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:06.463565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccd3d-e609-4426-9d4d-fe6e5b05dafe None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.498110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.498767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.499054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.499333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.569567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.571056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:06.638238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:06.669818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 563/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:06.675571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:06.765864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:06.775688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941581ac-d89b-4ae0-9827-36086c1f2926 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.809347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.810135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.810417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.810692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.821218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.822691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-0a24582e-32e4-492b-9dfc-d3dd780d8856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:06.841233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:06.842249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:06.843295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:36:06.843295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:06.843295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:36:06.843295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:06.843295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 531/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:06.848108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:06.905132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081b89-11f8-43bb-95b9-8a5940490ec4 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.905421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081b89-11f8-43bb-95b9-8a5940490ec4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.905703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081b89-11f8-43bb-95b9-8a5940490ec4 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.907070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 532/1095] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:06.912133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.912424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.912706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.929670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:06.931544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:06.951420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1022fcc-68a8-4eb2-b2ed-49e8b650d727 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:06.987977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:06.988641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:06.988927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:06.989202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:06.989934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:06.990247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:06.991904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.000693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 533/1096] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:36:07.005967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 564/1097] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:07.008935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.024798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.059904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.100849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.127852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475bdd-503c-49e0-ae3e-fc2ad17c07a9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.134991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111d5f0-b351-437a-9b24-25162c77075b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.163051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.163939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.164169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.164529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.169873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.170670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.170962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.171235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.171960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.173437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.181546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:36:07.187272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:07.188394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:07.189292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 534/1098] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:07.189792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:07.190618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:07.191439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 565/1099] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:36:07.194342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.196299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.293682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.305004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdb2c-c1cd-42e8-91a3-4c15abc1501b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.310043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53a43-b2ee-4196-8911-6ff1c4516d50 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.345315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.345986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.346275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.346558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.347361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:07.347707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.349161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.349836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.350511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.350801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.350941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.351075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.351876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:07.352191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.353641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.363162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 535/1100] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:07.368167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 566/1101] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:07.369647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.373946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.485456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b869d-002c-44fb-8fb5-28365070da66 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.485856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14992ed0-eac3-4e43-9d16-b5ba059df97d None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.531968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.532476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.533174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.533456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.534375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] RBAC: Adding query filter params (role.id=c43d0f90b816474ab8cff581f581185b, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=54774acef6c54a06a81facfe13173568) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:07.534735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.536264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.542862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 536/1102] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/role_assignments?user.id=54774acef6c54a06a81facfe13173568&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=c43d0f90b816474ab8cff581f581185b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:07.547297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.548319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.548615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.548893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] PATH_INFO: `/v3/users/15d80e7a002c4384bc063ef0f8e71441` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.550199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] RBAC: Authorizing `identity:get_user(user_id=15d80e7a002c4384bc063ef0f8e71441)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.551967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.553946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 567/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/users/15d80e7a002c4384bc063ef0f8e71441 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:07.560214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.625589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.674438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618f1c-4086-4ee5-be64-627a1c5fd8f9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:07.713548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:07.714219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:07.714507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:07.714788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:07.785134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:07.786610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:07.846929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:07.891419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 537/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:07.897529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:07.922701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:08.014366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b15a-c142-4f7c-b965-e83764158b05 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:08.050684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:08.051678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:08.052063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:08.052352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:08.053581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:08.055062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c0e04-9ecc-479c-96bb-75722ba331a2 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:08.057665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 568/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:07 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:08.063866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:08.166638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844009c-c36d-4d7e-822d-8901e091c317 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:08.201609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:08.202290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:08.202574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:08.202848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:08.203738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde, user.id=15d80e7a002c4384bc063ef0f8e71441) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:08.204054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:08.205495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496237-8be7-4a58-8a80-6c5b5f7e1d64 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:08.211870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 538/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:08 2022] GET /identity/v3/role_assignments?user.id=15d80e7a002c4384bc063ef0f8e71441&scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:10.309663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2727-a7b2-436f-a5e9-98ea723d09a9 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:10.310228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2727-a7b2-436f-a5e9-98ea723d09a9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:10.310228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2727-a7b2-436f-a5e9-98ea723d09a9 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:10.311616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 569/1107] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:10.317083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:10.317505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:10.317651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:10.334667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:10.335908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:10.352565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:10.403240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 539/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:10.428044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2727-a7b2-436f-a5e9-98ea723d09a9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:10.519718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:10.535327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2727-a7b2-436f-a5e9-98ea723d09a9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:10.568400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:10.569109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:10.569389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:10.569658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:10.571376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:10.572834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39545a52-6993-4b2d-b009-f5c8d82e5d79 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:10.574447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 570/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:10.580327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:10.679032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1fb2-5f71-4df3-9826-d9914dd88ee6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:10.713006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:10.713633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:10.713917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:10.714211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:10.714923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:10.716380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6b57-2b2b-4237-9f74-50d2703d8e0d None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:10.736176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 540/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:36:10 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:36:12.853315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a317-a8ce-4d0c-aaf7-8685ff510476 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:12.853827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a317-a8ce-4d0c-aaf7-8685ff510476 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:12.853827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572a317-a8ce-4d0c-aaf7-8685ff510476 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:12.855181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 571/1111] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:12.861574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:12.862004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:12.862127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:12.879601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:12.880781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:12.882760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:12.956796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 541/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:12.982142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a317-a8ce-4d0c-aaf7-8685ff510476 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:13.084819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572a317-a8ce-4d0c-aaf7-8685ff510476 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:13.120947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:13.121729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:13.122010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:13.122289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] PATH_INFO: `/v3/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:13.123789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] RBAC: Authorizing `identity:get_role(role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:13.125239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:13.126650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 572/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:12 2022] GET /identity/v3/roles/d4da261147b04e7288ffb922c442bf0e => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:13.132766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:13.231680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1be5a9-b846-42d3-8eae-4e19ff6b1bdc None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:13.265168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:13.266035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:13.266320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:13.266600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] PATH_INFO: `/v3/users/d74a3870224b49ffa12426ed15872317` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:13.275273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:13.283527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] RBAC: Authorizing `identity:get_user(user_id=d74a3870224b49ffa12426ed15872317)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:13.285277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:13.286963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 542/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:13 2022] GET /identity/v3/users/d74a3870224b49ffa12426ed15872317 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:13.293603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:13.318236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:13.400089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7671d-dcef-46ca-9f21-43e7e2b670e0 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:13.433304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:13.433946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:13.434228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:13.434503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:13.503996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:13.505441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:13.534109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:13.628876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 573/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:13.635318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:13.739576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0204d9c-1899-425a-ac7c-335a80f63706 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:13.774047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:13.774946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:13.775225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:13.775523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:13.776692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:13.778111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb807178-8732-4524-8e1d-da332ec661d2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:13.779904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 543/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:13 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:13.786094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:13.888319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382835-af42-47f6-8ace-f200bd782f43 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:13.911059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:13.923970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:13.924628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:13.924914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:13.925195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:13.926038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde, user.id=d74a3870224b49ffa12426ed15872317) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:13.926362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:13.927814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57c387-1c7e-4b4f-9a30-a2168a827deb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:13.934166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 574/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:13 2022] GET /identity/v3/role_assignments?user.id=d74a3870224b49ffa12426ed15872317&scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde&role.id=d4da261147b04e7288ffb922c442bf0e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:15.949080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa269e5-4ecb-4c1f-a0f3-2a6ffabfbd63 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:15.949649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa269e5-4ecb-4c1f-a0f3-2a6ffabfbd63 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:15.949649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa269e5-4ecb-4c1f-a0f3-2a6ffabfbd63 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:15.950998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 544/1118] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:15.956339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:15.956758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:15.956902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:15.974288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:15.975510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:16.041287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 575/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:16.063889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa269e5-4ecb-4c1f-a0f3-2a6ffabfbd63 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:16.128975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:16.169909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa269e5-4ecb-4c1f-a0f3-2a6ffabfbd63 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:16.204869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:16.205657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:16.205944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:16.206223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] PATH_INFO: `/v3/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:16.207807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] RBAC: Authorizing `identity:get_role(role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:16.209123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:16.210494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 545/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:16 2022] GET /identity/v3/roles/d4da261147b04e7288ffb922c442bf0e => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:16.217051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:16.320681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00cd29-7875-4f58-8a29-f5fce0e690ae None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:16.338917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:16.356372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:16.357236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:16.357516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:16.357790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] PATH_INFO: `/v3/users/d74a3870224b49ffa12426ed15872317` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:16.359074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] RBAC: Authorizing `identity:get_user(user_id=d74a3870224b49ffa12426ed15872317)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:16.360541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:16.362168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 576/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:16 2022] GET /identity/v3/users/d74a3870224b49ffa12426ed15872317 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:16.368935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:16.467189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb629a8-9bda-4c33-8d45-7d9111357046 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:16.495758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:16.500857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:16.501715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:16.502000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:16.502278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:16.503463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:16.504904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63498-16e8-4ade-be26-b4487d5691a6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:16.506595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 546/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:16 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:16.514493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:16.623003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5503-61b3-476d-bb9e-2a2f5516ef08 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:16.657277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:16.658174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:16.658459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:16.658736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde/users/d74a3870224b49ffa12426ed15872317/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:16.661032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=48e6532d9ac8456a9031d6f3aeaaafde, user_id=d74a3870224b49ffa12426ed15872317, role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:16.662475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867b8f4-b0a8-4113-b087-7aa52c8f61a4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:16.675054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 577/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:36:16 2022] PUT /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde/users/d74a3870224b49ffa12426ed15872317/roles/d4da261147b04e7288ffb922c442bf0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:36:18.705338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf9d6-c8d5-4a71-89b1-cb7f4eee3fb3 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:18.705885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf9d6-c8d5-4a71-89b1-cb7f4eee3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:18.705885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf9d6-c8d5-4a71-89b1-cb7f4eee3fb3 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:18.707238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 547/1124] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:18.712815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:18.713253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:18.713354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:18.731016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:18.732218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:18.775700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:18.803622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 578/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:18.827062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf9d6-c8d5-4a71-89b1-cb7f4eee3fb3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:18.926326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf9d6-c8d5-4a71-89b1-cb7f4eee3fb3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:18.961567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:18.962455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:18.962740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:18.963020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] PATH_INFO: `/v3/roles/d4da261147b04e7288ffb922c442bf0e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:18.964522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] RBAC: Authorizing `identity:get_role(role_id=d4da261147b04e7288ffb922c442bf0e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:18.965896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:18.967262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 548/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:18 2022] GET /identity/v3/roles/d4da261147b04e7288ffb922c442bf0e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:18.973202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:19.072012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa370-d19f-442c-bece-9a958d63bc47 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:19.105998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:19.106859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:19.107143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:19.107474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] PATH_INFO: `/v3/users/d74a3870224b49ffa12426ed15872317` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:19.108918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d74a3870224b49ffa12426ed15872317)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:19.110605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:19.112510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 579/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:18 2022] GET /identity/v3/users/d74a3870224b49ffa12426ed15872317 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:19.118658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:19.183803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:19.216558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa3a3-fe86-4f9d-bd24-e61105a390d4 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:19.256967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:19.257619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:19.257925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:19.258206 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:19.324387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:19.325806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:19.387257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:19.421379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 549/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:19.427467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:19.474870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:19.530474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80a5e4-877f-42a9-919b-5d80fdc4c2b5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:19.565166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:19.566011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:19.566297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:19.566576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] PATH_INFO: `/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:19.567794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] RBAC: Authorizing `identity:get_project(project_id=48e6532d9ac8456a9031d6f3aeaaafde)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:19.569232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0451d8-f536-4272-9636-6bc6371470e6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:19.570930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 580/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:19 2022] GET /identity/v3/projects/48e6532d9ac8456a9031d6f3aeaaafde => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:19.577208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:19.681605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f728f10-be42-42ce-8d42-a0aa58be3f56 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:19.717419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:19.718061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:19.718345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:19.718623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:19.719488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] RBAC: Adding query filter params (role.id=d4da261147b04e7288ffb922c442bf0e, scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde, user.id=d74a3870224b49ffa12426ed15872317) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:19.719811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:19.721236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae394c6-605b-4dbc-847a-85421d54100e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:19.726921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 550/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:19 2022] GET /identity/v3/role_assignments?user.id=d74a3870224b49ffa12426ed15872317&scope.project.id=48e6532d9ac8456a9031d6f3aeaaafde&role.id=d4da261147b04e7288ffb922c442bf0e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:21.811230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b27e-48fb-4aba-ae7d-274bdb7009cc None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:21.812615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b27e-48fb-4aba-ae7d-274bdb7009cc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:21.812907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b27e-48fb-4aba-ae7d-274bdb7009cc None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:21.814299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 581/1131] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:21.819695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:21.820102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:21.820264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:21.837736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:21.839016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:21.864869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:21.906416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 551/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:21.929883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19b27e-48fb-4aba-ae7d-274bdb7009cc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:22.036413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19b27e-48fb-4aba-ae7d-274bdb7009cc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:22.049739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:22.073353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:22.074069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:22.074355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:22.074636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:22.075853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:22.077300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de696ae3-1015-4cad-ba2c-d35614e1d133 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:22.078971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 582/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:22.084854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:22.180656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01b6e4-8088-484e-b4ad-3849f27cc763 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:22.216504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:22.217163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:22.217449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:22.217728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:22.218453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:22.219909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48503c06-3e70-41ac-8070-86270b2de654 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:22.245045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 552/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:36:22 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:36:24.338835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2b2a-03f2-4957-acc0-db068e875e9f None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:24.339395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2b2a-03f2-4957-acc0-db068e875e9f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:24.339395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2b2a-03f2-4957-acc0-db068e875e9f None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:24.340849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 583/1135] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:24.346104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:24.346506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:24.346663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:24.363512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:24.364684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:24.373879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:24.431176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 553/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:24.456605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2b2a-03f2-4957-acc0-db068e875e9f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:24.558586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2b2a-03f2-4957-acc0-db068e875e9f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:24.591959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:24.592667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:24.592947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:24.593220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:24.594384 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:24.595846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bc4e9-b160-42e8-8443-9184578c95f9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:24.597444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 584/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:24.603322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:24.701929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c646f3-3db5-487f-9442-f070b73bb9f1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:24.735225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:24.735924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:24.736215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:24.736498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:24.737223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:24.738661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a269-0a36-489a-9e77-901449d2812a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:24.754626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:24.760693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 554/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:36:24 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:36:26.838782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78417d6-9613-4141-8354-049739de9274 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:26.839290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78417d6-9613-4141-8354-049739de9274 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:26.839290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78417d6-9613-4141-8354-049739de9274 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:26.840652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 585/1139] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:26.845901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:26.846326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:26.846463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:26.863462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:26.864682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:26.932511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 555/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:26.955612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78417d6-9613-4141-8354-049739de9274 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.006156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:27.057343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78417d6-9613-4141-8354-049739de9274 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:27.092022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:27.092732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:27.093047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:27.093261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:27.104399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:27.112048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:27.113039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:27.113976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 586/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:27.120409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.217423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8c70-5bb0-4a7d-9433-f9b554e80fe4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:27.245575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:27.251753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:27.252419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:27.252700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:27.252973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:27.253729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:27.254033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:27.255382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:27.263822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 556/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:27.271086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.376390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1f1de-a1f8-4d8b-a8c6-0a81a2bd216c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:27.385248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:27.409913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:27.410786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:27.411062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:27.411335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] PATH_INFO: `/v3/users/57b6f7096e704efb8ca0510e5f59b41e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:27.425206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] RBAC: Authorizing `identity:get_user(user_id=57b6f7096e704efb8ca0510e5f59b41e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:27.426672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:27.428405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 587/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:27 2022] GET /identity/v3/users/57b6f7096e704efb8ca0510e5f59b41e => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:27.434208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.534743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8275c-bae0-49bb-92f8-645a8c9c7e62 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:27.568294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:27.568962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:27.569247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:27.569551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:27.627221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:27.637794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:27.639243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:27.738259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 557/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:27.744440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.841540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc95a-3918-4234-89ef-4fed9a40e63e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:27.874792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:27.875666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:27.875946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:27.876223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] PATH_INFO: `/v3/projects/f1ae5d9504f74c29864a89944c0142c1` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:27.877446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=f1ae5d9504f74c29864a89944c0142c1)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:27.878890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d16c5-9e6a-4c3e-877a-f671dc6c0ec4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:27.880692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 588/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:27 2022] GET /identity/v3/projects/f1ae5d9504f74c29864a89944c0142c1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:27.888439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:27.979611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:27.988653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f98fd-68d2-4458-ab38-394ac02ac071 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:28.023271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:28.023948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:28.024238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:28.024513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:28.025381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=f1ae5d9504f74c29864a89944c0142c1, user.id=57b6f7096e704efb8ca0510e5f59b41e) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:28.025698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:28.027147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21536022-59be-478a-a589-661abf7b20f1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:28.032469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 558/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:27 2022] GET /identity/v3/role_assignments?user.id=57b6f7096e704efb8ca0510e5f59b41e&scope.project.id=f1ae5d9504f74c29864a89944c0142c1&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:30.067376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcd35-1337-4ba7-bb97-3e2637fe0b4f None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.067955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcd35-1337-4ba7-bb97-3e2637fe0b4f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.067955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcd35-1337-4ba7-bb97-3e2637fe0b4f None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.069374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 589/1147] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:30.075096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.075574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.075700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.093305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:30.094513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:30.170403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 559/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:30.193420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fcd35-1337-4ba7-bb97-3e2637fe0b4f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:30.228556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:30.299426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fcd35-1337-4ba7-bb97-3e2637fe0b4f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:30.333201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:30.333910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.334195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.334474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.344799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:30.352875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:30.354018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:30.354891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 590/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:30.360210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:30.442757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:30.458655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec39f27-a29d-4567-84a9-b6795959ba61 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:30.491998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:30.492675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.493218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.493499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.494820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:30.495131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:30.496542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:30.504589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 560/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:30.510949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:30.608768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:30.616129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc44c1-2639-4486-aff9-ce1fb6801d67 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:30.649330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:30.650784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.651069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.651346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] PATH_INFO: `/v3/users/57b6f7096e704efb8ca0510e5f59b41e` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.652631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=57b6f7096e704efb8ca0510e5f59b41e)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:30.654069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:30.655834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 591/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:30 2022] GET /identity/v3/users/57b6f7096e704efb8ca0510e5f59b41e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:30.661913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:30.761615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624ac9-1fb2-4f18-99af-df4ccd851cd1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:30.797080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:30.797946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.798233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.798515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] PATH_INFO: `/v3/projects/f1ae5d9504f74c29864a89944c0142c1` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.799747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] RBAC: Authorizing `identity:get_project(project_id=f1ae5d9504f74c29864a89944c0142c1)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:30.801179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a688-ca7a-4b24-8c11-a63d6145c567 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:30.802880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 561/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:30 2022] GET /identity/v3/projects/f1ae5d9504f74c29864a89944c0142c1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:36:30.808877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:30.909799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494379d4-4590-43aa-bd24-1a331d147cd3 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:30.942859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:30.943776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:30.944062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:30.944373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] PATH_INFO: `/v3/projects/f1ae5d9504f74c29864a89944c0142c1/users/57b6f7096e704efb8ca0510e5f59b41e/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:30.946509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1ae5d9504f74c29864a89944c0142c1, user_id=57b6f7096e704efb8ca0510e5f59b41e, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:30.948620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9dec4-854e-4a54-b217-382081e15221 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:30.961761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 592/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:36:30 2022] PUT /identity/v3/projects/f1ae5d9504f74c29864a89944c0142c1/users/57b6f7096e704efb8ca0510e5f59b41e/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:36:32.980629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95190d6-f3a7-4ef3-8ef9-a450d7cd8b6f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:32.981163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95190d6-f3a7-4ef3-8ef9-a450d7cd8b6f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:32.981257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95190d6-f3a7-4ef3-8ef9-a450d7cd8b6f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:32.982556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 562/1154] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:32.987817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:32.988258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:32.988386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:33.006020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:33.007210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:33.024346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:33.079465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 593/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:33.102827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95190d6-f3a7-4ef3-8ef9-a450d7cd8b6f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:33.122699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:33.204562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95190d6-f3a7-4ef3-8ef9-a450d7cd8b6f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:33.238184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:33.238885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:33.239165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:33.239441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:33.249708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:33.257282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:33.258204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:33.259085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 563/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:33.264818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:33.362466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2badc0c-976b-4c6d-8a77-20f0c1205afa None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:33.395940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:33.396604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:33.396963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:33.397167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:33.397921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:33.398234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:33.399635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:33.408207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 594/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:33.414020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:33.492070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:33.515189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b137c-6362-468f-b734-4795575cec4e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:33.552582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:33.553464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:33.553746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:33.554117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] PATH_INFO: `/v3/users/57b6f7096e704efb8ca0510e5f59b41e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:33.555347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] RBAC: Authorizing `identity:get_user(user_id=57b6f7096e704efb8ca0510e5f59b41e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:33.556884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:33.558519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 564/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:33 2022] GET /identity/v3/users/57b6f7096e704efb8ca0510e5f59b41e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:33.564802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:33.581991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:33.668288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5019-8faf-4476-949d-8338d9afc4cf None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:33.706255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:33.706895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:33.707181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:33.707471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:33.788621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:33.789987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:33.805396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:33.890881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 595/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:33.896906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:33.998898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20730813-73b6-4f73-ad8b-08a18cd3b089 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:34.032988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:34.033844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:34.034132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:34.034410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] PATH_INFO: `/v3/projects/f1ae5d9504f74c29864a89944c0142c1` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:34.035620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] RBAC: Authorizing `identity:get_project(project_id=f1ae5d9504f74c29864a89944c0142c1)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:34.037072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce31ae-e3b3-4dd2-a0da-fdfb7a2f4eea None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:34.038828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 565/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:33 2022] GET /identity/v3/projects/f1ae5d9504f74c29864a89944c0142c1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:34.045567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:34.163096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584351-db04-4797-b2c0-397f9ceb98eb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:34.177451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:34.200623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:34.201274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:34.201558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:34.201831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:34.202664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=f1ae5d9504f74c29864a89944c0142c1, user.id=57b6f7096e704efb8ca0510e5f59b41e) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:34.202976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:34.204458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbb060-2a94-4f5c-82d9-ee0c692bd74e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:34.210435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 596/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:34 2022] GET /identity/v3/role_assignments?user.id=57b6f7096e704efb8ca0510e5f59b41e&scope.project.id=f1ae5d9504f74c29864a89944c0142c1&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:36.258099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ec9b-7bf8-4421-97b4-22390042d6bc None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:36.258688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ec9b-7bf8-4421-97b4-22390042d6bc None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:36.258688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5ec9b-7bf8-4421-97b4-22390042d6bc None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:36.260678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 566/1162] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:36.265907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:36.266354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:36.266470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:36.283254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:36.284482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:36.352569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 597/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:36.375541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5ec9b-7bf8-4421-97b4-22390042d6bc None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:36.391124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:36.478684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5ec9b-7bf8-4421-97b4-22390042d6bc None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:36.513758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:36.514339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:36.514624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:36.514908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:36.582179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:36.583650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:36.596978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:36.686667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 567/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 14:36:36.692722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:36.794711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40bbc7-ee16-45e8-8e95-396eaaf32304 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:36.804716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:36.834255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:36.835603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:36.836099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:36.836503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:36.843220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:36.844695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-681160eb-c2ca-4cd0-bb23-fb541d6f178b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:36.859846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:36.861136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:36.862273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 598/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:36:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:36.866993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:36.967252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234b0e-03d2-434a-abc8-a45badf482c1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:36.982279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:37.008470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:37.009157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:37.009443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:37.009725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:37.010470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:37.010781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:37.012194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e8392-854c-49a9-b038-529902b06448 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:37.019938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 568/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Jul 20 14:36:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:39.052023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1b3e-cf06-4078-b544-b9f7fb470fbd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:39.052583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1b3e-cf06-4078-b544-b9f7fb470fbd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:39.052583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b1b3e-cf06-4078-b544-b9f7fb470fbd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:39.053950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 599/1167] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:39.059796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e0e-73c0-451d-aa82-1fde6d9f0e12 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:39.060239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e0e-73c0-451d-aa82-1fde6d9f0e12 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:39.060346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e0e-73c0-451d-aa82-1fde6d9f0e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:39.077143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-84d03e0e-73c0-451d-aa82-1fde6d9f0e12 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:39.078356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-84d03e0e-73c0-451d-aa82-1fde6d9f0e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:39.146841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 569/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:39.170121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b1b3e-cf06-4078-b544-b9f7fb470fbd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:39.269989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b1b3e-cf06-4078-b544-b9f7fb470fbd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:39.304709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:39.305296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:39.305585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:39.305859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:39.306603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:39.308039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468ba8-1677-4305-88bc-7211ad861a38 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:39.322608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 600/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Wed Jul 20 14:36:39 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:36:41.380096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3659-c9d8-484d-b156-afc2b0a83ea4 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:41.380649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3659-c9d8-484d-b156-afc2b0a83ea4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:41.380649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3659-c9d8-484d-b156-afc2b0a83ea4 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:41.382048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 570/1170] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:41.387677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:41.388111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:41.388215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:41.404511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:41.405689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:41.428988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:41.477389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 601/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:41.501706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a3659-c9d8-484d-b156-afc2b0a83ea4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:41.603006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a3659-c9d8-484d-b156-afc2b0a83ea4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:41.610770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:41.638294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:41.639072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:41.639355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:41.639672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] PATH_INFO: `/v3/domains/42dadd5616514cb49350db952284a4ae` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:41.649937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=42dadd5616514cb49350db952284a4ae)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:41.652099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef6b8d-f92f-4ccb-afb9-ae34c2610246 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:41.653719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 571/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Jul 20 14:36:41 2022] GET /identity/v3/domains/42dadd5616514cb49350db952284a4ae => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:41.659642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:41.759466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfea38-c2e2-4c61-be08-58fdead42494 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:41.794436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:41.795099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:41.795388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:41.795695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:41.796419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:41.797858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266fa62-4171-4e06-8374-1dbe4b20e2ba None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:41.822137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 602/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:36:41 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:36:43.911480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e6ed-6d9b-4922-b427-b48b11eed718 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:43.912006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e6ed-6d9b-4922-b427-b48b11eed718 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:43.912006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e6ed-6d9b-4922-b427-b48b11eed718 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:43.913302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 572/1174] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:43.918523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:43.918969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:43.919071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:43.936904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:43.938324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:43.941512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:44.010085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 603/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:44.035192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1e6ed-6d9b-4922-b427-b48b11eed718 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:44.142681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1e6ed-6d9b-4922-b427-b48b11eed718 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:44.175881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:44.176665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:44.176950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:44.177227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] PATH_INFO: `/v3/domains/42dadd5616514cb49350db952284a4ae` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:44.178402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=42dadd5616514cb49350db952284a4ae)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:44.179859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8422a-8ba4-406f-ba26-7ef7dc5d8cf4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:44.181463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 573/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Jul 20 14:36:44 2022] GET /identity/v3/domains/42dadd5616514cb49350db952284a4ae => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:44.187428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:44.283991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4104-f4c8-44c8-a74a-c430f7170b55 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:44.317180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:44.317840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:44.318118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:44.318385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:44.319102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:44.320565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1927-d0e4-41bc-a9ee-e0dc3fb29b21 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:44.330509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:44.342726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 604/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:36:44 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:36:46.434023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eefd-fcaa-43c8-90bc-4d693984e554 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:46.434597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eefd-fcaa-43c8-90bc-4d693984e554 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:46.434597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eefd-fcaa-43c8-90bc-4d693984e554 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:46.435944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 574/1178] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:46.441103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:46.441491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:46.441670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:46.459541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:46.460732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:46.536180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 605/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:46.559493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04eefd-fcaa-43c8-90bc-4d693984e554 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:46.594991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:46.661000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04eefd-fcaa-43c8-90bc-4d693984e554 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:46.694120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:46.694902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:46.695189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:46.695487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:46.705955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:46.713682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:46.715121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:46.716209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 575/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:46.721151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:46.819877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2139-ca8a-4fee-9b42-1ae49353bbf9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:46.844841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:46.853815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:46.854490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:46.854767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:46.855041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:46.855823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:46.856133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:46.857501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:46.865449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 606/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:46.872438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:46.968093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:46.974950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ae51d-94c1-4ae9-b21f-01e053bc8302 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:47.008079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:47.008949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:47.009236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:47.009515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] PATH_INFO: `/v3/users/31568e2e2925430cb19a692c51b4de13` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:47.023177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] RBAC: Authorizing `identity:get_user(user_id=31568e2e2925430cb19a692c51b4de13)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:47.024669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:47.026355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 576/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:46 2022] GET /identity/v3/users/31568e2e2925430cb19a692c51b4de13 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:47.032370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:47.133462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8ed4-b600-41fe-8bcc-fd3fea2bd5dc None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:47.168237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:47.168884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:47.169170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:47.169451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:47.223938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:47.237526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:47.238984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:47.341057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 607/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:47.347039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:47.446219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d86f8-4f2d-4c56-a312-c7d4eef361f9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:47.481155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:47.481985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:47.482269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:47.482546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] PATH_INFO: `/v3/projects/780b68bd6418402e93900859d21ea28f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:47.483757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] RBAC: Authorizing `identity:get_project(project_id=780b68bd6418402e93900859d21ea28f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:47.485185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0f436-1e7a-489e-a9ca-7b2dc5bed142 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:47.486876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 577/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:47 2022] GET /identity/v3/projects/780b68bd6418402e93900859d21ea28f => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:47.493194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:47.580551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:47.593566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb72b1-8127-4c02-a018-d953bbad8a79 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:47.627624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:47.628276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:47.628564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:47.628843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:47.629685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=780b68bd6418402e93900859d21ea28f, user.id=31568e2e2925430cb19a692c51b4de13) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:47.630002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:47.631437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7ae23-5e3f-48d2-8cb5-199dfc3dfe4a None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:47.636932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 608/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:47 2022] GET /identity/v3/role_assignments?user.id=31568e2e2925430cb19a692c51b4de13&scope.project.id=780b68bd6418402e93900859d21ea28f&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:49.657769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1db97-0123-4ee8-b5e7-740904c911e2 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:49.658294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1db97-0123-4ee8-b5e7-740904c911e2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:49.658383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1db97-0123-4ee8-b5e7-740904c911e2 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:49.659706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 578/1186] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:49.664995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:49.665390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:49.665548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:49.683336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:49.684541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:49.751190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 609/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:49.774967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1db97-0123-4ee8-b5e7-740904c911e2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:49.796640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:49.876313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1db97-0123-4ee8-b5e7-740904c911e2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:49.912841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:49.913654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:49.913942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:49.914223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:49.926811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:49.935033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:49.936300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:36:49.937153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 579/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:49.942931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:50.023872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:50.042278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61622-5530-413c-ba9c-d67fc9f91779 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:50.076224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:50.076809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:50.077093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:50.077373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:50.078131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:50.078444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:50.079853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:50.088096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 610/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:50.094490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:50.175848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:50.196107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbb9fb-86d7-48d2-bf2e-5bb540ae905c None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:50.232864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:50.233721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:50.234000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:50.234270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] PATH_INFO: `/v3/users/31568e2e2925430cb19a692c51b4de13` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:50.235495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] RBAC: Authorizing `identity:get_user(user_id=31568e2e2925430cb19a692c51b4de13)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:50.236947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:50.238607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 580/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:50 2022] GET /identity/v3/users/31568e2e2925430cb19a692c51b4de13 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:50.244865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:50.355544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d6c3-f09f-46e5-af04-f0b6a79cf019 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:50.388923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:50.389777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:50.390060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:50.390333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] PATH_INFO: `/v3/projects/780b68bd6418402e93900859d21ea28f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:50.391539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] RBAC: Authorizing `identity:get_project(project_id=780b68bd6418402e93900859d21ea28f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:50.392985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f33e8-8e56-4385-a215-7cde87e79551 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:50.394686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 611/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:50 2022] GET /identity/v3/projects/780b68bd6418402e93900859d21ea28f => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:50.401295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:50.505066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fa139-2356-45b5-b8d0-109ba410c500 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:50.538869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:50.539792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:50.540077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:50.540356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] PATH_INFO: `/v3/projects/780b68bd6418402e93900859d21ea28f/users/31568e2e2925430cb19a692c51b4de13/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:50.542980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] RBAC: Authorizing `identity:create_grant(project_id=780b68bd6418402e93900859d21ea28f, user_id=31568e2e2925430cb19a692c51b4de13, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:50.544450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832ab4c-f7b1-43c1-95ee-0f2bc50efc66 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:50.558423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 581/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:36:50 2022] PUT /identity/v3/projects/780b68bd6418402e93900859d21ea28f/users/31568e2e2925430cb19a692c51b4de13/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:36:52.588008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb66b9-1f04-4232-9377-d0494b2cd807 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:52.588537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb66b9-1f04-4232-9377-d0494b2cd807 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:52.588632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb66b9-1f04-4232-9377-d0494b2cd807 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:52.590575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 612/1193] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:36:52.595843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:52.596248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:52.596403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:52.612831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:36:52.614076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:36:52.616076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:52.685857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 582/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:36:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:36:52.713435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb66b9-1f04-4232-9377-d0494b2cd807 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:52.730773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:52.818378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb66b9-1f04-4232-9377-d0494b2cd807 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:52.852859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:52.853759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:52.854099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:52.854436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:52.865435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:36:52.873957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:36:52.875105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:36:52.876170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 613/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:36:52.881358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:52.982222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e44de-734b-4fe7-b6bb-9761d7c4735a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:53.033865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:53.034564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:53.034852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:53.035130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:53.035942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:53.036258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:53.037649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:53.044076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:53.048003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 583/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:53.053488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:53.125143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:53.154530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece54945-fefe-4a24-9e3e-55dbf72ede67 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:53.188401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:53.189267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:53.189548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:53.189819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] PATH_INFO: `/v3/users/31568e2e2925430cb19a692c51b4de13` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:53.191031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] RBAC: Authorizing `identity:get_user(user_id=31568e2e2925430cb19a692c51b4de13)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:53.192488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:53.194120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 614/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Jul 20 14:36:53 2022] GET /identity/v3/users/31568e2e2925430cb19a692c51b4de13 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:53.199865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:53.298119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2067-e65b-4c97-b3cc-2473ada601f8 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:53.332554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:53.333223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:53.333499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:53.333783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:53.400421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:53.402709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:53.404621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:53.503091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 584/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:36:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:36:53.509191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:53.614522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29685f-3190-48b1-8dbf-336a8aebedac None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:53.647331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:53.648245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:53.648528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:53.648807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] PATH_INFO: `/v3/projects/780b68bd6418402e93900859d21ea28f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:53.649986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] RBAC: Authorizing `identity:get_project(project_id=780b68bd6418402e93900859d21ea28f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:53.652048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db03e1-a3c8-43c3-93bd-9de772885be4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:53.653680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 615/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Jul 20 14:36:53 2022] GET /identity/v3/projects/780b68bd6418402e93900859d21ea28f => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:36:53.659888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:36:53.755603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:36:53.758764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d0d1-d002-4d3d-92b2-683ad9e10dea None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:36:53.794149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:36:53.794798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:36:53.795081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:36:53.795358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:36:53.796211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=780b68bd6418402e93900859d21ea28f, user.id=31568e2e2925430cb19a692c51b4de13) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:36:53.796523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:36:53.797924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82f3db-8784-48fd-9ba5-c4763548491f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:36:53.803603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 585/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:36:53 2022] GET /identity/v3/role_assignments?user.id=31568e2e2925430cb19a692c51b4de13&scope.project.id=780b68bd6418402e93900859d21ea28f&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:03.643857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:03.801090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=18 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:50.449707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e036-bb46-4282-b489-7213a0c84835 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:50.450307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e036-bb46-4282-b489-7213a0c84835 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:50.450307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e036-bb46-4282-b489-7213a0c84835 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:50.452276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 616/1201] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:37:50.458037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:50.458531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:50.458616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:50.476461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:37:50.477781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:37:50.570213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 586/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:37:50.598582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e036-bb46-4282-b489-7213a0c84835 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:50.726850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e036-bb46-4282-b489-7213a0c84835 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:50.775950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:50.776928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:50.777240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:50.777560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:50.790361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:50.791986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:37:50.815122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:50.816326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:50.818029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:37:50.818029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:37:50.818029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:50.818029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:37:50.818029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 617/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:50.823189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:50.963659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff1958-bb03-433f-8865-96e036b789c5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:51.000468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:51.009928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:51.010647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:51.011022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:51.011308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:51.012113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:51.012508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:51.014578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78769f19-1595-424e-9795-fb82217b55f8 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:51.039686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 587/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:51.044037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:51.116433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:51.192697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa0cd-a42c-456a-9cba-cc5df45e3172 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:51.236578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:51.240705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:51.241201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:51.241556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:51.242466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:51.244112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa03d-dc76-4e64-8ad0-db797a51dc3c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:51.269237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 618/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Jul 20 14:37:51 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:37:53.638324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ab1-44eb-413f-80dc-b0ecca8bc302 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:53.638855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ab1-44eb-413f-80dc-b0ecca8bc302 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:53.639140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ab1-44eb-413f-80dc-b0ecca8bc302 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:53.640704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 588/1206] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:37:53.646635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:53.647124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:53.647221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:53.667396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:37:53.670354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:37:53.759891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 619/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:37:53.787673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554ab1-44eb-413f-80dc-b0ecca8bc302 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:53.918470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554ab1-44eb-413f-80dc-b0ecca8bc302 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:53.960354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:53.961296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:53.961628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:53.961920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:53.974331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:37:53.983793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:53.984823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:53.991704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 589/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:37:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:53.994671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:54.047269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:54.126360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadfc4-fedd-41e1-9d3c-f7032e38b454 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:54.168808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:54.169674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:54.169917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:54.170198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:54.171025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:54.171349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:54.172925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:54.184789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 620/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:37:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:54.191682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:54.251086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:54.308610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0bfe1-7f0e-4929-a2cd-8e4fedd74ba7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:54.352209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:54.353228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:54.353605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:54.353945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:54.368582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:54.370193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:37:54.405505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:54.406612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:54.407629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:37:54.407629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:37:54.407629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:54.407629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:54.407629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 590/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:54.407987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:54.542196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:54.546664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec2e86-2ba8-4b35-bd53-1924042bbed7 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:54.584559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:54.584770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:54.584966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:54.585256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:54.586082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:54.586394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:54.587935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:54.606573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 621/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:54.608587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:54.745985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34cd4-c4aa-4b31-9af0-eed224096f71 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:54.747878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:54.783530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:54.784319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:54.784603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:54.784877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] PATH_INFO: `/v3/users/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:54.792734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:54.794204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:37:54.811934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:54.813272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:54.814391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 591/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:54.819945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:54.957710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479edc-5c7c-47a3-a2fc-e491485d3d82 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:54.995016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:54.995917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:54.996382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:54.996801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:54.997801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:54.998282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:54.999838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:55.025108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 622/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:37:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:55.032224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:55.150459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad99d9-cd96-4a65-bf83-4bceb9c7339a None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:55.192065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:55.192724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:55.193009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:55.193289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:55.226498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:55.270785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:55.272287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:55.382436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 592/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:37:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:37:55.388397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:55.409077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:55.499143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78c3a-3c13-405d-97ae-8705ac0930ad None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:55.546255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:55.547060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:55.547335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:55.547666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:55.558349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:55.559836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:37:55.579018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:55.580255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:55.581159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:37:55.581159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:37:55.581159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:55.581159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:37:55.584958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 623/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:55.586478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:55.653666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:55.694632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0c403-8f34-43a1-a24c-4d707363b0bd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:55.731361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:55.732074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:55.732368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:55.733170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:55.734049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:55.734394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:55.735785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:55.749618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 593/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:55.755287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:55.844816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:55.881635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff55e6-47d9-4063-864d-7bd05d561937 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:55.918137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:55.919029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:55.919385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:55.919766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:55.927434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:55.928961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:37:55.947729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:55.948873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:37:55.950112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 624/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:55.955096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:56.071216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0a79-70df-498f-b0a8-60682a7c3325 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:56.104717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:56.118991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:56.119871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:56.120255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:56.120615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:56.121510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:56.121829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:56.123363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50f7ce-7ea8-414b-a335-12bc4670df2f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:56.142256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 594/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:56.143514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:56.269592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6590f7-c0ba-4b47-ae27-1598318fb459 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:56.308952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:56.318017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:56.319033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:56.319527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:56.319992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:56.321142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=90ce225267684e4b89e38e76fe317aa5) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:56.321643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:56.323573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeaaca-053c-4d3a-ad2f-8bde6d94b494 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:56.330746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 625/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:37:56 2022] GET /identity/v3/role_assignments?user.id=90ce225267684e4b89e38e76fe317aa5&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:37:58.465237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137736-8a23-452e-9760-03eb63799572 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:58.465862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137736-8a23-452e-9760-03eb63799572 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:58.465862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137736-8a23-452e-9760-03eb63799572 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:58.467812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 595/1220] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:37:58.473763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:58.474247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:58.474528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:58.494057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:37:58.495381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:37:58.572643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 626/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:37:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 14:37:58.596601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137736-8a23-452e-9760-03eb63799572 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:58.707834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137736-8a23-452e-9760-03eb63799572 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:58.746085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:58.746851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:58.747169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:58.747502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:58.759608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:37:58.767431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:58.768454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:58.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 596/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:58.774740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:58.886262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782df42-6b12-4765-b021-5f6ce340a1b5 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:58.909932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:58.923056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:58.923750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:58.924033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:58.924306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:58.925115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] RBAC: Adding query filter params (name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:58.925364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:58.926741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:58.935009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 627/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:58.944785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:58.992178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:59.057435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22440e1-e870-47cf-a772-c1f278335c49 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:59.098282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:59.099207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:59.099580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:59.099941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:59.113535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:59.115181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:37:59.135014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:59.136298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:59.137204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:37:59.137204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:37:59.137204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:59.137204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:59.137204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 597/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:59.142515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:59.253563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b7258-d477-4458-b42c-d381508ec585 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:59.289911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:59.290567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:59.290848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:59.291121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:59.291883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:59.292192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:59.293573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:59.305377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 628/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:59.311707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:59.409662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:59.417080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31820bc5-b97d-4006-811e-2ef12f5fa59e None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:59.460058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:59.460914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:59.461247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:59.461508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:59.473079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:59.474624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:37:59.490884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:59.492322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:59.494050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 598/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:59.499544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:59.558094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:37:59.620817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9ad4-bbcd-493b-8adc-b8c198b956bb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:59.665496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:59.666250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:59.666621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:59.666847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:59.667840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:37:59.668180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:59.669862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:59.693222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 629/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:37:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:37:59.699049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:37:59.831897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7964-fcd8-463d-8ae9-14299716c7f4 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:37:59.873977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:37:59.874918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:37:59.875260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:37:59.875933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:37:59.892025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:37:59.893657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:37:59.912868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:37:59.914030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:37:59.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:37:59.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:37:59.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:37:59.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:37:59.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 599/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:37:59.921106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:00.061687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c25d1-617b-494f-b293-ee67a16262d5 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:00.064438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:00.105170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:00.105902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:00.106190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:00.106471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:00.107220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:00.107566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:00.110208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:00.126625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 630/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:00.134378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:00.145953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:00.255359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843cbe-ee2e-452d-8020-06001b3c69dd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:00.291637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fd084-798a-4916-b218-57c592767601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:00.292470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fd084-798a-4916-b218-57c592767601 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:00.292734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fd084-798a-4916-b218-57c592767601 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:00.292998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fd084-798a-4916-b218-57c592767601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:00.303150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fd084-798a-4916-b218-57c592767601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:00.304730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fd084-798a-4916-b218-57c592767601 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-907fd084-798a-4916-b218-57c592767601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:38:00.320545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:00.321636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:00.322741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:00.323730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 600/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:00.329838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:00.449704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d44a1-d594-4a71-b376-b3d0e3116dcb None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:00.486038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:00.486802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:00.487151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:00.487151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:00.487151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:00.487151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:00.487151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34faf6c7-e8d9-4f2e-9a0c-f2b4cc77e594 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:00.507284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 631/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:00.510207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fd084-798a-4916-b218-57c592767601 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:00.590100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:00.631258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fd084-798a-4916-b218-57c592767601 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:00.671575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:00.672603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:00.672922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:00.673222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/90ce225267684e4b89e38e76fe317aa5/roles/04f3740e68f14f39b71a6f2d1a475e3d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:00.689630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=90ce225267684e4b89e38e76fe317aa5, role_id=04f3740e68f14f39b71a6f2d1a475e3d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:00.691154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f5f7-0350-44b1-b992-ed75ccf2bbb2 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:00.705210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 601/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:38:00 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/90ce225267684e4b89e38e76fe317aa5/roles/04f3740e68f14f39b71a6f2d1a475e3d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:38:02.870456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b1ae-1d2f-4da8-872c-3e71f687e7fd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:02.871426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b1ae-1d2f-4da8-872c-3e71f687e7fd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:02.871426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743b1ae-1d2f-4da8-872c-3e71f687e7fd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:02.873760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 632/1233] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:02.879959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:02.880477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:02.880567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:02.897169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:02.898326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:02.970524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 602/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:02.994682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743b1ae-1d2f-4da8-872c-3e71f687e7fd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:03.022679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:03.118891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743b1ae-1d2f-4da8-872c-3e71f687e7fd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:03.162462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:03.163242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:03.163640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:03.163979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:03.176136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:38:03.184540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:03.185675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:03.186753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 633/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Jul 20 14:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:38:03.192592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:03.246048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:03.306961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de2d39-ea9a-4cda-ab1d-b5848ad9e158 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:03.346749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:03.347933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:03.348360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:03.349042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:03.350160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] RBAC: Adding query filter params (name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:03.350630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:03.352308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:03.363482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 603/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Jul 20 14:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:03.369442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:03.466812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:03.484939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e67ed2-3274-4b5e-878c-5eb6f38bb1aa None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:03.524417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:03.525397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:03.525694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:03.525984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:03.540891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:03.542920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:03.562520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:03.563700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:03.564866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:03.564866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:03.564866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:03.564866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:03.564866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 634/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:03.570855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:03.684793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942846f-708a-4494-a844-b6aad27a9557 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:03.697305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:03.726139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:03.726734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:03.727021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:03.727302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:03.728069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:03.728527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:03.729870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:03.743055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 604/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:03.748688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:03.866556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6fae-6699-42d0-9de2-10906645ba60 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:03.910392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:03.911424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:03.911745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:03.912043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:03.915939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:03.923001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:03.924764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:38:03.942964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:03.944239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:03.945284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:03.945902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 635/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:03.953088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:04.067947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4cd7-bad1-423e-9979-80660b7050cd None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:04.116291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:04.117069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:04.117497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:04.117856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:04.118920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:04.119325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:04.121241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:04.144752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 605/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:38:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:04.151084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:04.267044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95290ab-c027-4324-9f9c-83e8767d6222 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:04.308844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:04.309505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:04.309791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:04.310072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:04.376597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:04.383688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:04.385161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:04.498339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 636/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:38:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:38:04.505086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:04.536904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:04.618309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1793f5c-a787-4c6b-83c9-45f6b4edb01b None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:04.659170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:04.659971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:04.660329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:04.660653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:04.672419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:04.673876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:04.695643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:04.696777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:04.697771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:04.697771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:04.697771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:04.697771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:04.697771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 606/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:04.704045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:04.812039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:04.819163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6102-a38a-4348-8f50-09faa0b411ad None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:04.855872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:04.856544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:04.856842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:04.857128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:04.858421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:04.858782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:04.860207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:04.873108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 637/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:04.879684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:04.965555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:04.991415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f15708-9787-4fc8-affb-b6f46e097b43 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:05.029991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:05.031076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:05.031370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:05.031703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:05.041139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:05.043019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:38:05.060901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:05.062684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:05.064025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 607/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:05.068422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:05.187074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaf98-33d5-47af-8007-b41b2c625687 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:05.227025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:05.227653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:05.227999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:05.228254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:05.229014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:05.229358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:05.230774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0737a-a231-41c4-80ac-e03103b4537e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:05.243602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 638/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:05.250375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:05.365622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61d384-f26b-4b72-a581-49b23bef0ffe None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:05.404260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:05.405721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:05.406308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:05.406646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:05.407621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] RBAC: Adding query filter params (role.id=04f3740e68f14f39b71a6f2d1a475e3d, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=90ce225267684e4b89e38e76fe317aa5) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:05.407971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:05.409533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684186bb-a3c8-47bb-8cf4-5caab0528f6a None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:05.416198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 608/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:38:05 2022] GET /identity/v3/role_assignments?user.id=90ce225267684e4b89e38e76fe317aa5&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=04f3740e68f14f39b71a6f2d1a475e3d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:07.712914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764a5c-0f0e-40d5-9f0b-beaee71dd74e None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:07.713520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764a5c-0f0e-40d5-9f0b-beaee71dd74e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:07.713520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764a5c-0f0e-40d5-9f0b-beaee71dd74e None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:07.715041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 639/1247] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:07.721762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:07.722325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:07.722325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:07.728446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:07.743777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:07.745105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:07.829490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 609/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:07.857743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe764a5c-0f0e-40d5-9f0b-beaee71dd74e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:07.881017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:07.980851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe764a5c-0f0e-40d5-9f0b-beaee71dd74e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:08.020671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:08.021477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:08.021809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:08.022051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:08.032824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:38:08.040400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:08.047386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:08.048553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 640/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:08.050612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:08.180838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f11c3-4989-466e-9123-08ebd8cd0520 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:08.216193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:08.222356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:08.223115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:08.223406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:08.223833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:08.224668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:08.224870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:08.226408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:08.236775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 610/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:08.243790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:08.350695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:08.382898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923754-cda6-4aea-bf63-49c3e800dddd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:08.424985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:08.425817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:08.426101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:08.426378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:08.441045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:08.443063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:08.467322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:08.468654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:08.470078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:08.470078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:08.470078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:08.470078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:08.470078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 641/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:08.475586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:08.602804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b73e-0de7-4856-a13c-b41ab94f9a26 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:08.645393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:08.646084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:08.646372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:08.646691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:08.647420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:08.647773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:08.649342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:08.664589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 611/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:08.670489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:08.781909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceb500-ffcf-4589-a238-5b025b80ff35 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:08.812360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:08.822085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:08.822800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:08.823095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:08.823363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:08.832352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:08.833976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:38:08.853265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:08.854278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:08.855382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 642/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:08.862150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:08.935258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:09.002269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec0fb-1599-47aa-945e-ad31ef29f6dc None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:09.041606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:09.042213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:09.042514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:09.042861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:09.043829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:09.044139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:09.045674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:09.065027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 612/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:38:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:09.071057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:09.211437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0717a-655f-4939-aa21-99a1368689ab None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:09.258965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:09.259744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:09.260076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:09.260407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:09.334746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:09.349867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:09.351361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:09.475052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 643/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:38:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:38:09.481390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:09.612040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20940e-e42e-49bb-8c11-bf508e72f7b1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:09.627509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:09.651922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:09.652726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:09.653019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:09.653321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:09.663714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:09.665131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:09.684877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:09.686774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:09.687883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:09.687883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:09.687883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:09.687883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:09.687883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 613/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:38:09.692890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:09.795816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:09.808925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe6afe-8a3c-4a2b-af04-6fcc55da82f8 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:09.847299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:09.848112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:09.848397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:09.848727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:09.849591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:09.849973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:09.851607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:09.864935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 644/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:09.870892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:09.989827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83b40-4139-4efc-a794-b0e04454b004 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:10.032870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:10.033721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:10.034011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:10.034294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:10.044647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:10.046760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:38:10.063212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:10.064363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:10.065633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 614/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 14:38:10.070888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:10.192178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65da5d1-ae33-4034-80a0-8fc067be41dd None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:10.230600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:10.231267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:10.231572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:10.231850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:10.232648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:10.233066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:10.235065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af503d4-3c05-4a70-9123-dfd57eff9aa4 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:10.247511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 645/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:10.254680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:10.282530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:10.385368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981d731-5564-489e-980a-0c7aa0ea2c7f None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:10.424645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:10.425316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:10.425635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:10.425890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:10.426742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=90ce225267684e4b89e38e76fe317aa5) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:10.427061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:10.428544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c625-1ede-49ba-9942-c0d8ca5a0ebe None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:10.434934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 615/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:38:10 2022] GET /identity/v3/role_assignments?user.id=90ce225267684e4b89e38e76fe317aa5&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:12.582089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1f6e-65ae-46d9-bb6e-685e3c4af12b None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:12.582645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1f6e-65ae-46d9-bb6e-685e3c4af12b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:12.582645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd1f6e-65ae-46d9-bb6e-685e3c4af12b None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:12.584148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 646/1261] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:12.589594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:12.590148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:12.590148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:12.607433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:12.608705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:12.675306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 616/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:12.704452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd1f6e-65ae-46d9-bb6e-685e3c4af12b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:12.717441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:12.813501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd1f6e-65ae-46d9-bb6e-685e3c4af12b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:12.848054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:12.848847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:12.849134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:12.849410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:12.859635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:38:12.867360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:12.868521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:12.869749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 647/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:12.876284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:12.895339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:12.979023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8339f9-68ab-49ed-8d18-c3c5db0862b0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.015643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.016308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.016601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.016879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.017627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:13.017937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.019298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.027346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 617/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:13.033354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.102358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:13.144971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1f65-0f9d-474a-9a05-e3a89842a7a4 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.187978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.188775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.189063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.189357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.200006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.201459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:13.218199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:13.219207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:13.220220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:13.220220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:13.220220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:13.220220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:13.220220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 648/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:13.225391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.305062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:13.325322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee864c-e527-43f5-bfbd-ce734d1260f7 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.359444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.360070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.360361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.360642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.361375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:13.361687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.363054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.375603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 618/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:13.382100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.484525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fecc7f-538b-49d5-b0fb-4fed4f69071e None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.505062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:13.519760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.520589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.520867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.521138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.528994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.530742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:38:13.545329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:13.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:13.547676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 649/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:13.552584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.658035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30241b-ee2e-4cca-a336-5a7bf09a9aa1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.694857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.695625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.695940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.696227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.697129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:13.697468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.698994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.708419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:13.717928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 619/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:38:13.723580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.822400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17cc5-662a-4e8f-8556-1ef538e9bc3c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:13.854524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:13.855301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:13.855613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:13.855984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:13.866576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:13.868038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:13.885714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:13.886664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:13.887782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:13.887782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:13.887782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:13.887782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:13.887782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 650/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:13.892839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:13.991467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44644-414d-4fd5-a771-703f67fa9aa6 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:14.024427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:14.025362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:14.025362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:14.025639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:14.026427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:14.026819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:14.028221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:14.039285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 620/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:14.044924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:14.077382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:14.148782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3ce8-1268-41d8-84eb-d6f25f9bb69b None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:14.182545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:14.183327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:14.183728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:14.184003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:14.190723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:14.192188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:38:14.206168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:14.207224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:14.208358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 651/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:14.213260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:14.271547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:14.313690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701ca42-18be-47d5-938f-1443658c28e9 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:14.346659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:14.347317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:14.347635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:14.347917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:14.348707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:14.349018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:14.350460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82b59e-9af7-4e10-b38c-01b065564cef None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:14.363778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 621/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:14.369965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:14.461627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:14.470592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dacb3e-9659-4f7b-976f-d149e0345503 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:14.506461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:14.507354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:14.507657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:14.507934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] PATH_INFO: `/v3/projects/d132cd5b9542485a9994e9251b10873b/users/90ce225267684e4b89e38e76fe317aa5/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:14.509929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d132cd5b9542485a9994e9251b10873b, user_id=90ce225267684e4b89e38e76fe317aa5, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:14.511370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5e9cb-554d-4568-9237-330b38f0aae9 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:14.525741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 652/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Jul 20 14:38:14 2022] PUT /identity/v3/projects/d132cd5b9542485a9994e9251b10873b/users/90ce225267684e4b89e38e76fe317aa5/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:38:16.544126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6326a-365f-49a3-842e-9ca8ebf44977 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:16.544576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6326a-365f-49a3-842e-9ca8ebf44977 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:16.544693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6326a-365f-49a3-842e-9ca8ebf44977 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:16.546080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 622/1274] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:16.551567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:16.551977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:16.552157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:16.571267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:16.572540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:16.647712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 653/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:16.674074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6326a-365f-49a3-842e-9ca8ebf44977 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:16.776347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6326a-365f-49a3-842e-9ca8ebf44977 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:16.793553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:16.810943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:16.812395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:16.812643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:16.812931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:16.822879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 14:38:16.830537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:16.831662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:16.832625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 623/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Jul 20 14:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:16.837818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:16.919237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:16.939193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6836923-f3b9-4f30-8454-17c513571e51 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:16.972839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:16.973519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:16.973801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:16.974072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:16.974815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:16.975121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:16.976514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:16.985084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 654/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Jul 20 14:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:16.990995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:17.095419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23a0f-b49a-4cba-8986-aa70ae0db9ba None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:17.139211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:17.140253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:17.140663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:17.141012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:17.155103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:17.157145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:17.174663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:17.175760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:17.176879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:17.176879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:17.176879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:17.176879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:17.176879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 624/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:17.181807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:17.281688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8a3e-e223-4cc4-99b0-f419e438f836 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:17.316980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:17.316980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:17.316980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:17.316980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:17.317435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:17.317435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:17.318938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:17.334941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 655/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:17.341798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:17.381223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:17.451597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1499e-151b-4a06-abfc-c2c77f650847 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:17.485198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:17.485983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:17.486264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:17.486538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:17.493970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:17.495385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 14:38:17.510192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:17.511338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:17.512733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 625/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:17.517470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:17.521347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:17.615650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca6e47-acb4-494a-8de5-dfeee6f32573 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:17.650029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:17.650615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:17.650895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:17.651170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:17.652044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:17.652356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:17.653790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:17.671015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 656/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Jul 20 14:38:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:17.677433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:17.786530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:17.797958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d018-aedc-4c92-8be9-cb3b0ef38b90 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:17.835464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:17.836129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:17.836419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:17.836702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:17.910210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:17.911903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.009870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:18.022525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 626/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Jul 20 14:38:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 14:38:18.029199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:18.097630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:18.136861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa6e1a-1b9e-4443-8a95-c4b6539a5bd6 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:18.170414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:18.171178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:18.171999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:18.172276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:18.182596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:18.184090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 14:38:18.201463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:18.207711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:18.208819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 14:38:18.208819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 14:38:18.208819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 14:38:18.208819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:18.208819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 657/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:18.209168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:18.305415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410a85-96d7-4e4f-8168-b309e6b82669 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:18.338522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:18.339178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:18.339484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:18.339772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:18.340506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:18.340824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:18.342203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.354327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 627/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Jul 20 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:18.360059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:18.458061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af37e5-1cf4-40d9-a277-d3722236916f None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:18.473032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:18.493573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:18.494361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:18.494637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:18.494912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:18.501680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:18.503363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 14:38:18.518058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:18.519135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: ERROR keystone.server.flask.application Jul 20 14:38:18.520095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 658/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Jul 20 14:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:18.526046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:18.577269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:18.629231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a8e1-a129-469a-ba14-663dab9f2e49 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:18.662748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:18.663412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:18.663732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:18.664015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:18.664814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:18.665131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:18.666556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980cc0e-3c24-45f7-8bfe-1ab9044083fa None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.678505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 628/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Jul 20 14:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:18.684602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:18.791416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708d7c-de54-4ec9-87a5-5723fa5e510c None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:18.829356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:18.830155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:18.830512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:18.830833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:18.831774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] RBAC: Adding query filter params (role.id=feb024fd5f1a4880bb9594368aa0345c, scope.project.id=d132cd5b9542485a9994e9251b10873b, user.id=90ce225267684e4b89e38e76fe317aa5) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:18.832160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:18.833844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7255c-ff6c-416d-8d12-3b312e87e9ef None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:18.839899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 659/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Jul 20 14:38:18 2022] GET /identity/v3/role_assignments?user.id=90ce225267684e4b89e38e76fe317aa5&scope.project.id=d132cd5b9542485a9994e9251b10873b&role.id=feb024fd5f1a4880bb9594368aa0345c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:20.870535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e2d7-1e09-4d85-8445-200b409b1c7a None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:20.871038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e2d7-1e09-4d85-8445-200b409b1c7a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:20.871038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66e2d7-1e09-4d85-8445-200b409b1c7a None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:20.872404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 629/1288] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:20.877951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:20.878366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:20.878509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:20.895961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:20.897157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:20.927152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:20.971043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 660/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:20.994924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66e2d7-1e09-4d85-8445-200b409b1c7a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:21.101139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66e2d7-1e09-4d85-8445-200b409b1c7a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:21.114852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:21.148187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:21.149067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:21.149404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:21.149774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:21.150729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:21.152544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:21.168259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:21.169549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:21.170456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 630/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:38:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:21.176203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:21.272810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a89bf-95ab-4835-9261-c1d95cefd7ff None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:21.307182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:21.307885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:21.308169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:21.308445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:21.309166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:21.309477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:21.310852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b199bd-902f-4132-b8fd-cb0106b65af6 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:21.315800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 661/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Jul 20 14:38:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:21.321843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:21.428499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a1866-0c15-4504-99bd-d5e57c1ddf37 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:21.463426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:21.464219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:21.464552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:21.464863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] PATH_INFO: `/v3/services` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:21.465701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] RBAC: Adding query filter params (type=placement) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:21.466025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:21.467601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759dba9-f906-4eec-9041-96b24de915da None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:21.473294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 631/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Jul 20 14:38:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:23.480139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39fa-48fc-4b22-8d69-407ef16fb665 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:23.480762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39fa-48fc-4b22-8d69-407ef16fb665 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:23.480762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39fa-48fc-4b22-8d69-407ef16fb665 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:23.482078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 662/1293] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:23.489264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783318-f997-4043-9eb0-1d33c8fd06cd None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:23.489857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783318-f997-4043-9eb0-1d33c8fd06cd None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:23.490136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783318-f997-4043-9eb0-1d33c8fd06cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:23.507865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d8783318-f997-4043-9eb0-1d33c8fd06cd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:23.509106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d8783318-f997-4043-9eb0-1d33c8fd06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:23.541379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:23.579767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 632/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:23.602982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f39fa-48fc-4b22-8d69-407ef16fb665 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:23.633919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:23.705543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f39fa-48fc-4b22-8d69-407ef16fb665 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:23.740941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:23.741510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:23.741795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:23.742072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:23.742798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:23.744214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff70a61-a114-4e67-a53d-6c83c5e8e5fc None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:23.757743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 663/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Jul 20 14:38:23 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:38:25.837590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15278d3-0bb3-47bb-a00b-ff9e32037921 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:25.838193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15278d3-0bb3-47bb-a00b-ff9e32037921 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:25.838193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15278d3-0bb3-47bb-a00b-ff9e32037921 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:25.839416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 633/1296] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:25.844544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:25.845008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:25.845131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:25.861927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:25.863101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:25.934475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 664/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:25.957611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15278d3-0bb3-47bb-a00b-ff9e32037921 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:26.058324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15278d3-0bb3-47bb-a00b-ff9e32037921 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:26.094677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:26.095402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:26.095713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:26.095996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:26.096659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:26.098241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:26.112052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:26.113268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:26.114158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 634/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:38:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:26.119419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:26.140498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:26.232960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38db3-4553-4650-aa0e-531d3c05d31b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:26.270788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:26.271648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:26.272028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:26.272406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:26.273381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:26.273853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:26.275288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:26.280409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 665/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Jul 20 14:38:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:26.287044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:26.318191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:26.386907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175881f-4299-4217-a2be-e7a22d1543d1 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:26.420997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:26.422598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:26.422598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:26.422908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:26.423689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] RBAC: Adding query filter params (interface=public, service_id=f72b69daf4204534b49a22abe52bdd72, region_id=RegionOne) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:26.424013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:26.425604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7a2b6-ea57-4223-b907-b49068072cba None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:26.431438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 635/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Jul 20 14:38:26 2022] GET /identity/v3/endpoints?service_id=f72b69daf4204534b49a22abe52bdd72&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:26.438126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:26.520412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:26.540438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf703-a741-4c62-bca6-caf6b31cee38 None admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:26.573678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:26.574338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:26.574623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:26.574902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:26.575618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:26.576983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c369b8-a83c-4762-8571-f5e423ad9315 None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:26.584185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 666/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Jul 20 14:38:26 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:38:28.591157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde98d-15e4-4952-a5c7-dacb19f19b33 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:28.591702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde98d-15e4-4952-a5c7-dacb19f19b33 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:28.591824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dde98d-15e4-4952-a5c7-dacb19f19b33 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:28.593108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 636/1302] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:38:28.598904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:28.599304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:28.599575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:28.617486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:38:28.618679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:38:28.686297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 667/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:38:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 14:38:28.709781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dde98d-15e4-4952-a5c7-dacb19f19b33 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:28.804011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:28.811256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dde98d-15e4-4952-a5c7-dacb19f19b33 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:28.845132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:28.845913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:28.846195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:28.846468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:28.847121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:28.848515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 14:38:28.860160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 14:38:28.861319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application with Lock( Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self._enter() Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application return self.creator() Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application created_value = creator( Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: ERROR keystone.server.flask.application Jul 20 14:38:28.862192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 637/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Jul 20 14:38:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 14:38:28.867573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:28.942578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:28.966648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31c5f-119c-479c-b975-d55e9e85402d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:29.000168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:29.000828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:29.001115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:29.001402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] PATH_INFO: `/v3/services` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:29.002112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:38:29.002425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:29.004092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06661c-6bbc-4a85-b879-cbd07ece74aa None admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:29.009152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 668/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Jul 20 14:38:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:38:29.015047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:38:29.126291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe903bf-0f2d-4620-9fa5-f1ce754d5969 None admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:38:29.161100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:38:29.161751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:38:29.162035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:38:29.162312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:38:29.163049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:38:29.164446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c964e6-f336-48be-ac27-a7707d3ec550 None admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:38:29.184545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 638/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Jul 20 14:38:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:38:39.006220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=30 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:38:39.180148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:33.452675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b5d4-c836-4d55-8091-ceeb2bd94417 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:33.453251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b5d4-c836-4d55-8091-ceeb2bd94417 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:33.453251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3b5d4-c836-4d55-8091-ceeb2bd94417 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:33.458535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 669/1307] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:33.460648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59acecf-7695-4149-ae1c-fa67474c6d08 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:33.461054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59acecf-7695-4149-ae1c-fa67474c6d08 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:33.461272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59acecf-7695-4149-ae1c-fa67474c6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:33.594652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b59acecf-7695-4149-ae1c-fa67474c6d08 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:33.596748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b59acecf-7695-4149-ae1c-fa67474c6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:33.792303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 639/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:33.823443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:33.823755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:33.824075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:33.825790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 670/1309] 10.222.0.23 () {54 vars in 965 bytes} [Wed Jul 20 14:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:33.833777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fff50-a52d-4f7a-8cf0-ffe2fe95ff4e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:33.834077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fff50-a52d-4f7a-8cf0-ffe2fe95ff4e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:33.834360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fff50-a52d-4f7a-8cf0-ffe2fe95ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:33.917064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-cc4fff50-a52d-4f7a-8cf0-ffe2fe95ff4e None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:33.918358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cc4fff50-a52d-4f7a-8cf0-ffe2fe95ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:33.940889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:34.003254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 640/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Jul 20 14:39:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:34.013623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:34.015237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:34.135178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d7e09-7277-47a8-a9f9-902607ae1aff None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:34.214155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:34.214808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:34.215093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:34.215367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:34.217086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:34.279358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:34.353160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:34.354816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7755e8-b450-4cb1-a7c9-8ddff0f5c0fa service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:34.375214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 671/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:36.730731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:36.731287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:36.731287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:36.732865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 641/1312] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:36.738029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42e3c-1d9b-43ae-b80b-66b83014373c None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:36.738510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42e3c-1d9b-43ae-b80b-66b83014373c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:36.738632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42e3c-1d9b-43ae-b80b-66b83014373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:36.823713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-18a42e3c-1d9b-43ae-b80b-66b83014373c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:36.824794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-18a42e3c-1d9b-43ae-b80b-66b83014373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:36.947561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 672/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:36.987238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:36.988894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:37.103223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331bf17-53f0-447f-b65e-151f2807acac None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:37.190952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:37.194401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:37.195438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:37.195736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:37.196056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:37.198591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:37.321525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:37.322976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb95be-9041-46af-8fbc-f65266f10695 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:37.341911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 642/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:39.825951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ef80-0ec2-4906-9a4e-ef102f06404d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:39.826529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ef80-0ec2-4906-9a4e-ef102f06404d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:39.826529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ef80-0ec2-4906-9a4e-ef102f06404d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:39.828293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 673/1315] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:39.833435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013911a-337c-4cf6-83fd-5d5ed3c58f40 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:39.833889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013911a-337c-4cf6-83fd-5d5ed3c58f40 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:39.834028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013911a-337c-4cf6-83fd-5d5ed3c58f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:39.907829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-3013911a-337c-4cf6-83fd-5d5ed3c58f40 None None] MFA Rules not processed for user `2abfb209701446c896dcb9124dc4513c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:39.909074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3013911a-337c-4cf6-83fd-5d5ed3c58f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:39.968404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:40.016935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 643/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:40.071812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:40.072106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:40.072388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:40.073767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 674/1317] 10.222.0.23 () {54 vars in 965 bytes} [Wed Jul 20 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:40.079649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0386-d09b-4c06-b9ae-67c1c442e379 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:40.079889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0386-d09b-4c06-b9ae-67c1c442e379 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:40.080217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0386-d09b-4c06-b9ae-67c1c442e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:40.157305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-51cc0386-d09b-4c06-b9ae-67c1c442e379 None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:40.158542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-51cc0386-d09b-4c06-b9ae-67c1c442e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:40.239522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 644/1318] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Jul 20 14:39:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:40.256172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:40.257737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:40.268530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:40.364678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd083-a624-45e2-8c27-adad1866ea71 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:40.441544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:40.442812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:40.443096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:40.443372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:40.445072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:40.511388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:40.560240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:40.561750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977f9dd-af1c-4a5d-a505-650528216007 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:40.580966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 675/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:43.613121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:43.613948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:43.614170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:43.616674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 645/1320] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:43.623440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd2c5-b2a3-48a7-ad22-9b1990bf83f3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:43.623981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd2c5-b2a3-48a7-ad22-9b1990bf83f3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:43.624459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd2c5-b2a3-48a7-ad22-9b1990bf83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:43.710649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d81cd2c5-b2a3-48a7-ad22-9b1990bf83f3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:43.711926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d81cd2c5-b2a3-48a7-ad22-9b1990bf83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:43.809250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 676/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:43.851630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:43.853303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:43.906011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:43.976486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163b4ca-ffd4-485b-a3eb-3486ef6471f2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:44.050451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:44.051102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:44.051389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:44.051709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:44.053481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:44.154713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:44.168723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:44.170235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ec77-fb2c-4cd5-a518-ac1d25ae929d service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:44.190064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 646/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:47.099663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:47.100332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:47.100332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:47.101946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 677/1323] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:47.107559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56bb9-ad41-4ee8-833e-1061c1f16517 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:47.107995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56bb9-ad41-4ee8-833e-1061c1f16517 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:47.108321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa56bb9-ad41-4ee8-833e-1061c1f16517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:47.178573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-afa56bb9-ad41-4ee8-833e-1061c1f16517 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:47.179833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-afa56bb9-ad41-4ee8-833e-1061c1f16517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:47.282996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 647/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:47.320367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:47.322259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:47.343517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:47.440508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6c421-6ffc-4281-9e27-cf3958a185d3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:47.521421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:47.522082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:47.522388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:47.522710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:47.524609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:47.604165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:47.649167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:47.650648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd95791-38cc-475c-a6f4-3e1b76e74376 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:47.674729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 678/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:49.935735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:49.936257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:49.936379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:49.937712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 648/1326] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:49.944050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354914-6d91-49d4-a209-df030b93b91a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:49.944787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354914-6d91-49d4-a209-df030b93b91a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:49.944967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7354914-6d91-49d4-a209-df030b93b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:50.016610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d7354914-6d91-49d4-a209-df030b93b91a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:50.017596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d7354914-6d91-49d4-a209-df030b93b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:50.160566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 679/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:39:50.205074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:50.206646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:50.287526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:50.335273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d3b71-a3d3-42fc-8bd7-ca9ada2c14ce None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:50.412631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:50.413284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:50.413572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:50.413850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:50.416017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:50.543114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:50.546475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:50.548869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d301e-bee4-4ed6-b9ac-e149392f46b5 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:50.579111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 649/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:39:52.810828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:52.811440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:52.811440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:52.812694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 680/1329] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:52.818879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097a00-de04-4b82-83f6-c1d740cef090 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:52.819556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097a00-de04-4b82-83f6-c1d740cef090 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:52.819890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097a00-de04-4b82-83f6-c1d740cef090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:52.907679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c7097a00-de04-4b82-83f6-c1d740cef090 None None] MFA Rules not processed for user `2abfb209701446c896dcb9124dc4513c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:52.909027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c7097a00-de04-4b82-83f6-c1d740cef090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:53.016754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 650/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:53.074282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:53.075920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:53.113359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:53.201800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12575-9b3b-481e-9f86-de75e809ad1e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:53.285256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:53.286038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:53.286483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:53.286878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:53.288875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:53.378244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:53.417031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:53.418955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf83b6-5730-4d0b-8423-628ddd0ad4eb service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:53.441539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 681/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:55.883304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:55.883880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:55.883972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:55.885535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 651/1332] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:55.891217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed041-ade5-4d3c-bd5c-7882805d164b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:55.891678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed041-ade5-4d3c-bd5c-7882805d164b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:55.891945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed041-ade5-4d3c-bd5c-7882805d164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:55.990035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-2a1ed041-ade5-4d3c-bd5c-7882805d164b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:55.992711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2a1ed041-ade5-4d3c-bd5c-7882805d164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:56.107994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 682/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:39:56.147907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:56.149538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:56.222326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:56.258008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b63ca-6d57-4801-b29f-434035eaa6b6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:56.341034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:56.341602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:56.341892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:56.342175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:56.343878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:56.468980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:56.470468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde2b81-11f0-46f9-83a2-8a0424581f56 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:56.481659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:56.491183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 652/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:39:58.585094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:58.585637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:58.585637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:58.587024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 683/1335] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:39:58.592846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1c83-eb75-4e58-a9b9-1387c05a9b30 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:58.593301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1c83-eb75-4e58-a9b9-1387c05a9b30 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:58.593421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1c83-eb75-4e58-a9b9-1387c05a9b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:58.660900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-50df1c83-eb75-4e58-a9b9-1387c05a9b30 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:39:58.662780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-50df1c83-eb75-4e58-a9b9-1387c05a9b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:58.761918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 653/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:39:58.802904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:39:58.804831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:58.848785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:58.916944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20972f-4a14-4c43-b997-ebe760e311a2 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:39:58.993955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:39:58.994606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:39:58.994886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:39:58.995158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:39:58.996842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:39:59.091944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:39:59.139204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:39:59.140710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a435f4-a920-484f-a7cf-2867aa87c009 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:39:59.171476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 684/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:01.648142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:01.648735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:01.648735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:01.650076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 654/1338] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:01.655346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecdf0-c416-4a1e-b7bd-b9d235769956 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:01.655817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecdf0-c416-4a1e-b7bd-b9d235769956 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:01.655927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecdf0-c416-4a1e-b7bd-b9d235769956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:01.731385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f08ecdf0-c416-4a1e-b7bd-b9d235769956 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:01.732681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f08ecdf0-c416-4a1e-b7bd-b9d235769956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:01.848276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 685/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:01.885051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:01.886853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:01.969604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:02.000305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133afc-2c4f-43e8-a072-7c24b0172f1f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:02.074667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:02.075316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:02.075628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:02.075908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:02.077592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:02.194961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:02.196457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63178dd-0bfe-4ab0-be75-20b6283d8f06 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:02.215576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 655/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:06.773687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:06.773687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:06.774351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:06.775496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 686/1341] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:06.781221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dd71f-a314-443c-a4e6-3908a9222756 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:06.781906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dd71f-a314-443c-a4e6-3908a9222756 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:06.781906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dd71f-a314-443c-a4e6-3908a9222756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:06.786750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:06.856218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-699dd71f-a314-443c-a4e6-3908a9222756 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:06.857714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-699dd71f-a314-443c-a4e6-3908a9222756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:06.968026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 656/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:07.008858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:07.010456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:07.063136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:07.127469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14053-08b4-4216-a782-6cbe7b050a8a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:07.212936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:07.213602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:07.213946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:07.214222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:07.215937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:07.317167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:07.335200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:07.336691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527a297-3cb5-483a-b602-11771b29fad4 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:07.355560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 687/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:10.147360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:10.148145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:10.148405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:10.150647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 657/1344] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:40:10.157958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f246-d41a-420d-8a96-bdcb33cf484f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:10.158714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f246-d41a-420d-8a96-bdcb33cf484f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:10.158714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f246-d41a-420d-8a96-bdcb33cf484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:10.248441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5d93f246-d41a-420d-8a96-bdcb33cf484f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:10.249745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5d93f246-d41a-420d-8a96-bdcb33cf484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:10.410546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 688/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:10.457495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:10.460008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:10.598189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:10.631664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbe749-fdf2-4523-b95e-9a1d3ea1e1e3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:10.749001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:10.750136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:10.750395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:10.750830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:10.753813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:10.911863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:10.913851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0e02b-0f29-4104-9a89-6f5098b67587 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:10.936501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 658/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:15.338743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:15.339299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:15.339299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:15.340699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 689/1347] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:15.347953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02d07-105d-4aec-9cc1-e3d1d617f33e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:15.348718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02d07-105d-4aec-9cc1-e3d1d617f33e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:15.348942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02d07-105d-4aec-9cc1-e3d1d617f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:15.365615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:15.444104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6ad02d07-105d-4aec-9cc1-e3d1d617f33e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:15.445930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6ad02d07-105d-4aec-9cc1-e3d1d617f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:15.572105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 659/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:15.634935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:15.636522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:15.709084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:15.767622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80141-5cc0-4cbb-8fe2-a73d3d005a49 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:15.884616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:15.885189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:15.885478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:15.885760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:15.888594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:16.022846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:16.027504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:16.029389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed33a63-b2ee-4fd8-a34a-700186bac67d service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:16.052319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 690/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:40:21.940494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f290-bb74-4e08-b205-f1eb6bc7d722 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:21.941122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f290-bb74-4e08-b205-f1eb6bc7d722 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:21.941122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f290-bb74-4e08-b205-f1eb6bc7d722 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:21.942654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 660/1350] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:21.948235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff3d-78cc-4218-b9a9-530f1b29af7a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:21.949758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff3d-78cc-4218-b9a9-530f1b29af7a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:21.949758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ff3d-78cc-4218-b9a9-530f1b29af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:22.082262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f901ff3d-78cc-4218-b9a9-530f1b29af7a None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:22.083701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f901ff3d-78cc-4218-b9a9-530f1b29af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:22.252304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 691/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:40:25.569926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=59 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:26.371455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931321-b116-4290-a9bf-bcaba9149f2d None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:26.371909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931321-b116-4290-a9bf-bcaba9149f2d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:26.372138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931321-b116-4290-a9bf-bcaba9149f2d None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:26.373772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 661/1352] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:26.379390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedc0e-37a9-46c0-8b9b-184ffb7b09e6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:26.379975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedc0e-37a9-46c0-8b9b-184ffb7b09e6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:26.380283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eedc0e-37a9-46c0-8b9b-184ffb7b09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:26.438781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:26.464957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-67eedc0e-37a9-46c0-8b9b-184ffb7b09e6 None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:26.466293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-67eedc0e-37a9-46c0-8b9b-184ffb7b09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:26.597160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 692/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:27.971962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a95a-788e-4a17-adf7-e2263476d2b6 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:27.972491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a95a-788e-4a17-adf7-e2263476d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:27.972634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a95a-788e-4a17-adf7-e2263476d2b6 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:27.974833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 662/1354] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:27.979873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef372d-a2e4-47c3-ab89-abd58d544b8a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:27.980298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef372d-a2e4-47c3-ab89-abd58d544b8a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:27.980439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef372d-a2e4-47c3-ab89-abd58d544b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:28.057324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1fef372d-a2e4-47c3-ab89-abd58d544b8a None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:28.058538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1fef372d-a2e4-47c3-ab89-abd58d544b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:28.102826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:28.171322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 693/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:31.730108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a212-4cca-4e96-a535-a865ceba0580 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:31.730641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a212-4cca-4e96-a535-a865ceba0580 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:31.730641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a212-4cca-4e96-a535-a865ceba0580 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:31.735572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 663/1356] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:31.737816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51ec1-585c-400e-b734-9eaeb9b1088e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:31.738235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51ec1-585c-400e-b734-9eaeb9b1088e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:31.739156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51ec1-585c-400e-b734-9eaeb9b1088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:31.827632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a4a51ec1-585c-400e-b734-9eaeb9b1088e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:31.829166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a4a51ec1-585c-400e-b734-9eaeb9b1088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:31.958018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 694/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:32.014719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:32.015305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:32.015819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:32.017797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 664/1358] 10.222.0.23 () {54 vars in 962 bytes} [Wed Jul 20 14:40:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:32.030401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c90-9412-4505-9d04-343d1ea197b6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:32.030401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c90-9412-4505-9d04-343d1ea197b6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:32.030713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c528c90-9412-4505-9d04-343d1ea197b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:32.049110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:32.137325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4c528c90-9412-4505-9d04-343d1ea197b6 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:32.138586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4c528c90-9412-4505-9d04-343d1ea197b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:32.293302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 695/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Jul 20 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:32.297366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:32.298934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:32.461638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269034-182e-436e-aaea-76d08c50b2e1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:32.566414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:32.612068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:32.612765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:32.613072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:32.613359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:32.615020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:32.724578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:32.726165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632a4b6-49a1-41ae-9779-1199a91ff789 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:32.747020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 665/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:35.096085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:35.096708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:35.097138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:35.098912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 696/1361] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:40:35.104451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ead9-72bc-4850-a0ed-aeb6602da066 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:35.104915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ead9-72bc-4850-a0ed-aeb6602da066 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:35.105096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ead9-72bc-4850-a0ed-aeb6602da066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:35.174086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a938ead9-72bc-4850-a0ed-aeb6602da066 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:35.175510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a938ead9-72bc-4850-a0ed-aeb6602da066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:35.214747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:35.291442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 666/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:35.338337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:35.340195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:35.440817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:35.589209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d260a6-8ddc-43d7-9005-95cd13c282ea None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:35.731672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:35.732430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:35.732781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:35.733128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:35.735724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:35.765501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:35.841426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:35.843507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa8e4e-2275-46a8-acd6-dc31c957589c service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:35.867231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 697/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:38.331108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818ce-1e70-45c7-8d9b-7493d24ae9ef None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:38.331717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818ce-1e70-45c7-8d9b-7493d24ae9ef None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:38.332075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818ce-1e70-45c7-8d9b-7493d24ae9ef None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:38.333758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 667/1364] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:38.339476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804cd7-a27b-49ad-ba0d-ecdabf702cdb None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:38.339935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804cd7-a27b-49ad-ba0d-ecdabf702cdb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:38.340112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804cd7-a27b-49ad-ba0d-ecdabf702cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:38.415610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-45804cd7-a27b-49ad-ba0d-ecdabf702cdb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:38.416878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-45804cd7-a27b-49ad-ba0d-ecdabf702cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:38.524792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:38.535607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 698/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:38.573412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:38.573934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:38.574684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:38.576241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 668/1366] 10.222.0.23 () {54 vars in 962 bytes} [Wed Jul 20 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:38.582685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77c9e-a9d5-4054-b78a-bce2478a79a0 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:38.583149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77c9e-a9d5-4054-b78a-bce2478a79a0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:38.583638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77c9e-a9d5-4054-b78a-bce2478a79a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:38.667420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-48b77c9e-a9d5-4054-b78a-bce2478a79a0 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:38.668741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-48b77c9e-a9d5-4054-b78a-bce2478a79a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:38.799090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 699/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Jul 20 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:38.806941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:38.808720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:38.978602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fa4f7-e8a6-4c29-be35-2c0428751316 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:39.001696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:39.104440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:39.105272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:39.105672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:39.106052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:39.107863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:39.207975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:39.209806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b0f92-915f-4642-b59b-dde9f7682ddd service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:39.231381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 669/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:40.141398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110872-5c57-449b-9afa-3d9cc71a5970 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:40.141938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110872-5c57-449b-9afa-3d9cc71a5970 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:40.141938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b110872-5c57-449b-9afa-3d9cc71a5970 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:40.143512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 700/1369] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:40.148882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abcdf-e72f-46df-b229-8c18049e84da None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:40.149366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abcdf-e72f-46df-b229-8c18049e84da None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:40.149366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abcdf-e72f-46df-b229-8c18049e84da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:40.181688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:40.235503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-840abcdf-e72f-46df-b229-8c18049e84da None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:40.236780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-840abcdf-e72f-46df-b229-8c18049e84da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:40.346582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 670/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:40.667355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:40.667796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:40.668182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:40.669798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 701/1371] 10.222.0.23 () {54 vars in 964 bytes} [Wed Jul 20 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:40.675285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cebb70-4740-44ca-b084-9fb7d08fbbf4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:40.675722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cebb70-4740-44ca-b084-9fb7d08fbbf4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:40.676113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cebb70-4740-44ca-b084-9fb7d08fbbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:40.758378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-36cebb70-4740-44ca-b084-9fb7d08fbbf4 None None] MFA Rules not processed for user `dae0c98ee06544579ca6cdbe1163a028`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:40.759840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-36cebb70-4740-44ca-b084-9fb7d08fbbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:40.811982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:40.846644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 671/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Wed Jul 20 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:40.854485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:40.856162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:40.916126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:40.982436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd2b2-27d7-4246-8d43-90ca44373ab6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:41.065326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:41.066017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:41.066217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:41.066459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:41.068156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:41.175371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:41.190623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:41.192127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adb8f3-a1c4-4f4a-8c5d-8c9f6a082d22 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:41.212781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 702/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:41.370986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:41.371423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:41.371423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:41.377255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 672/1374] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:41.378575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae6ef-2e59-46cd-824b-170e011af409 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:41.378955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae6ef-2e59-46cd-824b-170e011af409 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:41.379137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ae6ef-2e59-46cd-824b-170e011af409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:41.452627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-133ae6ef-2e59-46cd-824b-170e011af409 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:41.453841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-133ae6ef-2e59-46cd-824b-170e011af409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:41.568410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 703/1375] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:40:41.620573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:41.622090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:41.776695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67096fb3-eb2a-46b8-bb85-2d9e2ba52678 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:41.836443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:41.906129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:41.906858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:41.907212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:41.907582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:41.909331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:42.015507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:42.017274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e104d6-9818-43e7-b59a-c8231538b2a4 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:42.035757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 673/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:44.151624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:44.152147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:44.152231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:44.154580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 704/1377] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:44.160117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ad37-effb-4870-a777-cf2d71423d75 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:44.160555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ad37-effb-4870-a777-cf2d71423d75 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:44.160697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01ad37-effb-4870-a777-cf2d71423d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:44.226694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ae01ad37-effb-4870-a777-cf2d71423d75 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:44.227970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ae01ad37-effb-4870-a777-cf2d71423d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:44.237025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:44.354605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 674/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:44.395698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:44.397264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:44.464993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:44.571196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c71a6-9c71-429e-8104-84282dcc6210 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:44.693485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:44.694170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:44.694469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:44.694730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:44.696499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:44.725974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:44.822593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:44.824914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d1104-467f-4b42-a77b-c4371b2c970c service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:44.855222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 705/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:47.016092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:47.016639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:47.016639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:47.018376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 675/1380] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:40:47.024165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3e701-3450-4bad-95ca-6f6f59d5b0e5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:47.024655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3e701-3450-4bad-95ca-6f6f59d5b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:47.024793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3e701-3450-4bad-95ca-6f6f59d5b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:47.107951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-76b3e701-3450-4bad-95ca-6f6f59d5b0e5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:47.109023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-76b3e701-3450-4bad-95ca-6f6f59d5b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:47.216480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:47.226555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 706/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:40:47.275378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:47.277220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:47.427980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:47.440409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2025d7-e9c5-472a-b7e1-b66f1b0d7306 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:47.569251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:47.569909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:47.570200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:47.570483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:47.572170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:47.674837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:47.676479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884737-80d2-4bb6-b9f3-f02b48cf87f7 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:47.687634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:47.697183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 676/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:49.828251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:49.828782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:49.828782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:49.830239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 707/1383] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:49.835551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d109a9-b1fb-40f7-92a4-7e936d604313 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:49.835986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d109a9-b1fb-40f7-92a4-7e936d604313 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:49.836125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d109a9-b1fb-40f7-92a4-7e936d604313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:49.905216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-33d109a9-b1fb-40f7-92a4-7e936d604313 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:49.906507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-33d109a9-b1fb-40f7-92a4-7e936d604313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:50.013913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 677/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:50.056900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:50.058758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:50.209361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37248-107a-4046-83e6-3bbca8d02661 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:50.286368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:50.335856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:50.336614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:50.336903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:50.337185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:50.339544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:50.440238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:50.442255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f7604-1fcf-4044-91e4-2157a7f78de2 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:50.466859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 708/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:52.505745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:52.506311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:52.506311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:52.507707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 678/1386] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:52.513694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7028-48ff-4f29-bb5e-da6a140d1550 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:52.514189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7028-48ff-4f29-bb5e-da6a140d1550 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:52.514286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7028-48ff-4f29-bb5e-da6a140d1550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:52.582722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c0df7028-48ff-4f29-bb5e-da6a140d1550 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:52.583975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c0df7028-48ff-4f29-bb5e-da6a140d1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:52.619139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:52.690485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 709/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:52.735564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:52.737456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:52.830608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:52.912348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db45b01-f2ee-4669-aca0-f8e6003580a7 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:53.033467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:53.034145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:53.034437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:53.034722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:53.036462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:53.082576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:53.141541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:53.143137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6be2ea-aa55-4bcd-aaf9-274ce8aa7b9f service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:53.161413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 679/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:55.270624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:55.271049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:55.271193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:55.272738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 710/1389] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:55.279226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d2e0-a674-4cab-9b24-bcc6c53e226e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:55.279673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d2e0-a674-4cab-9b24-bcc6c53e226e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:55.279840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d2e0-a674-4cab-9b24-bcc6c53e226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:55.488663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8c83d2e0-a674-4cab-9b24-bcc6c53e226e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:55.489920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8c83d2e0-a674-4cab-9b24-bcc6c53e226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:55.606210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 680/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:40:55.653164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:55.654719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:55.833201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b83821-0450-47ce-bb91-a720c1874a43 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:55.852112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:55.970787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:55.971511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:55.971763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:55.972042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:55.973719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:56.066708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:56.068365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ffb9-fce7-4e90-8b49-ecffd187381d service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:56.087298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 711/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:40:58.188685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:58.189263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:58.189263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:58.190576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 681/1392] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:40:58.197607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c430-363c-459c-ac5b-6db84feb79dd None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:58.198083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c430-363c-459c-ac5b-6db84feb79dd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:58.198192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c430-363c-459c-ac5b-6db84feb79dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:58.223049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:58.268256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8d06c430-363c-459c-ac5b-6db84feb79dd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:40:58.269608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8d06c430-363c-459c-ac5b-6db84feb79dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:58.368828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 712/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:40:58.415205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:40:58.417122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:58.434352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:58.581818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff62a7-7daf-4d4f-8a2c-645f2cc65616 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:40:58.672612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:40:58.701072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:40:58.701855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:40:58.702211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:40:58.702561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:40:58.704858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:40:58.812011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:40:58.814450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fcd3c-4e45-4b35-a5ce-9e6ce54b6488 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:40:58.838435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 682/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:00.994099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:00.994694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:00.994694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:00.996315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 713/1395] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:01.001683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234bb0-8409-4417-934b-890eba557c26 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:01.002097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234bb0-8409-4417-934b-890eba557c26 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:01.002248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234bb0-8409-4417-934b-890eba557c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:01.067387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d1234bb0-8409-4417-934b-890eba557c26 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:01.069256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d1234bb0-8409-4417-934b-890eba557c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:01.135969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:01.198929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 683/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:01.246189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:01.247685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:01.348262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:01.406304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f47db-81b1-43ac-8d19-2fb4a603decd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:01.536271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:01.536936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:01.537725 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:01.538004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:01.539756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:01.605720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:01.635443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:01.637102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015467-836a-4a66-afac-2ef3d3117263 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:01.655045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 714/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:02.313453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79826b1-448a-4e82-bc0d-ab060db96f11 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:02.313990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79826b1-448a-4e82-bc0d-ab060db96f11 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:02.313990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79826b1-448a-4e82-bc0d-ab060db96f11 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:02.315439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 684/1398] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:02.320915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19394d-7ac9-43a0-8cae-813408e3b6db None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:02.321365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19394d-7ac9-43a0-8cae-813408e3b6db None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:02.321461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19394d-7ac9-43a0-8cae-813408e3b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:02.387239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eb19394d-7ac9-43a0-8cae-813408e3b6db None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:02.388470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eb19394d-7ac9-43a0-8cae-813408e3b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:02.497205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 715/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:41:02.556489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46213765-607a-4870-b5b4-098c766677b1 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:02.556780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46213765-607a-4870-b5b4-098c766677b1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:02.557066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46213765-607a-4870-b5b4-098c766677b1 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:02.558474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 685/1400] 10.222.0.23 () {54 vars in 966 bytes} [Wed Jul 20 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:02.563723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b471a4-b6c5-4e39-a4e1-00ccd2cb89ec None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:02.564064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b471a4-b6c5-4e39-a4e1-00ccd2cb89ec None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:02.564444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b471a4-b6c5-4e39-a4e1-00ccd2cb89ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:02.611199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:02.641889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-81b471a4-b6c5-4e39-a4e1-00ccd2cb89ec None None] MFA Rules not processed for user `9fc7a82e40184ae28526ca41ddca25d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:02.643191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-81b471a4-b6c5-4e39-a4e1-00ccd2cb89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:02.726559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 716/1401] 10.222.0.23 () {58 vars in 1063 bytes} [Wed Jul 20 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:02.734279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46213765-607a-4870-b5b4-098c766677b1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:02.736001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-46213765-607a-4870-b5b4-098c766677b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:02.844364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46213765-607a-4870-b5b4-098c766677b1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:02.928818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:02.929478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:02.929764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:02.930045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:02.931734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:02.934815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:03.043661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:03.045108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58f480-2269-4157-bb43-16b6dfe53933 service glance] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:03.063532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 686/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:03.808674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671172-b039-42ed-b586-f71669c12b8d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:03.809423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671172-b039-42ed-b586-f71669c12b8d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:03.809423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df671172-b039-42ed-b586-f71669c12b8d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:03.810626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 717/1403] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:03.817385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:03.817870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:03.818155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:03.829645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6f4be-a1f4-45a1-b75e-d1f08f5f334a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:03.829932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6f4be-a1f4-45a1-b75e-d1f08f5f334a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:03.830426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6f4be-a1f4-45a1-b75e-d1f08f5f334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:03.890851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:03.892102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:03.899112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-17d6f4be-a1f4-45a1-b75e-d1f08f5f334a None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:03.900351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-17d6f4be-a1f4-45a1-b75e-d1f08f5f334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:03.950883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:03.986004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:03.992571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 718/1404] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:03.996117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 687/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:41:04.037149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251df51-3219-4024-bca2-33e685d71c4d None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:04.037453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251df51-3219-4024-bca2-33e685d71c4d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:04.037825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251df51-3219-4024-bca2-33e685d71c4d None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:04.039292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 719/1406] 10.222.0.23 () {54 vars in 943 bytes} [Wed Jul 20 14:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:04.041774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:04.042982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:04.045582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:04.045956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:04.046239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:04.125106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] MFA Rules not processed for user `a52d17454c264a51a14b1d6a7786b570`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:04.126328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:04.159438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcc86e-fe39-4738-a395-403f460b7fe0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:04.230725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:04.237953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 720/1407] 10.222.0.23 () {58 vars in 1040 bytes} [Wed Jul 20 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:41:04.247571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:04.257596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ced2c-7d09-4739-a674-c9f8884b407c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:04.287567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:04.288280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:04.288567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:04.288847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:04.290784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:04.314692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:04.371516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:04.372166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:04.372445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:04.372719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:04.374652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:04.387781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:04.389623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9ec5-f0a0-457b-be65-abbaf14b8afe service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:04.408658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 688/1408] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:41:04.461985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:04.463849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7905c-d591-46d8-ab38-0e938277e2e1 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:04.474062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 721/1409] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:41:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 14:41:14.406101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=64 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:14.470159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=64 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:26.975487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffcc2-0d7e-4e46-868b-0bbf221a43ea None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:26.976072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffcc2-0d7e-4e46-868b-0bbf221a43ea None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:26.976179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccffcc2-0d7e-4e46-868b-0bbf221a43ea None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:26.977709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 689/1410] 10.222.0.23 () {54 vars in 918 bytes} [Wed Jul 20 14:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:26.985070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438124c-d8ed-4dd8-bf15-ba9141b56cd6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:26.985645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438124c-d8ed-4dd8-bf15-ba9141b56cd6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:26.985924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438124c-d8ed-4dd8-bf15-ba9141b56cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:27.086223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c438124c-d8ed-4dd8-bf15-ba9141b56cd6 None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:27.088367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c438124c-d8ed-4dd8-bf15-ba9141b56cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:27.211210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 722/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Jul 20 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:41:27.226311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856633-9d86-41a1-a372-4444292fa5bd None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:27.226655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856633-9d86-41a1-a372-4444292fa5bd None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:27.226945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856633-9d86-41a1-a372-4444292fa5bd None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:27.228217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 690/1412] 10.222.0.23 () {54 vars in 918 bytes} [Wed Jul 20 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:27.233751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf556da-5dbe-4089-865e-32022df42854 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:27.234216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf556da-5dbe-4089-865e-32022df42854 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:27.234579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf556da-5dbe-4089-865e-32022df42854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:27.322870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:27.326759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-adf556da-5dbe-4089-865e-32022df42854 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:27.328635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-adf556da-5dbe-4089-865e-32022df42854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:27.451149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 723/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Jul 20 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:30.037507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:30.038128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:30.038251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:30.039773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 691/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:30.045768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb285-0843-41c5-a3f7-4fbde618649a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:30.046231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb285-0843-41c5-a3f7-4fbde618649a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:30.046341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bb285-0843-41c5-a3f7-4fbde618649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:30.113027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e97bb285-0843-41c5-a3f7-4fbde618649a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:30.114284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e97bb285-0843-41c5-a3f7-4fbde618649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:30.174050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:30.225519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 724/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:30.272572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:30.274104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:30.421799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba090fa5-3fe5-4538-87f3-5efabc35b32f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:30.508734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:30.554580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:30.555243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:30.555563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:30.555849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:30.557533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:30.652626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:30.654525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4354f-cbf2-4ac2-bd28-cade71faa371 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:30.674933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 692/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:31.609653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:31.610207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:31.610207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:31.611531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 725/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:31.616829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837393e-7004-4366-be9f-b18c034d2d14 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:31.617298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837393e-7004-4366-be9f-b18c034d2d14 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:31.617395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837393e-7004-4366-be9f-b18c034d2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:31.691732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-9837393e-7004-4366-be9f-b18c034d2d14 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:31.692939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9837393e-7004-4366-be9f-b18c034d2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:31.720805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:31.802818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 693/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:31.954398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:31.956993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:32.110870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec872bd-c859-490c-9117-7d1e4c7b6073 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:32.157085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:32.239662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:32.240234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:32.240525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:32.240861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:32.242552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:32.336628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:32.338236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dddd3-86f3-42d5-a1d3-9ef1594636ec service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:32.356473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 726/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:33.272196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:33.272922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:33.272922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:33.274215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 694/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:33.279689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bc08-95b4-4b66-940c-a1e48b4a089a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:33.280157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bc08-95b4-4b66-940c-a1e48b4a089a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:33.280320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bc08-95b4-4b66-940c-a1e48b4a089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:33.335460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:33.361376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-fa65bc08-95b4-4b66-940c-a1e48b4a089a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:33.362915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fa65bc08-95b4-4b66-940c-a1e48b4a089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:33.464907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 727/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:33.635050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:33.637211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:33.804741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e1b8-fb01-485f-a5da-b64b75bd2c34 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:33.821079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:33.926096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:33.926752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:33.927028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:33.927326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:33.929137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:34.026274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:34.027921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19eaa3-6f43-42ce-a68b-13efd843c5f6 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:34.047568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 695/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:34.946039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:34.946631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:34.946631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:34.948537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 728/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:34.953800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d478ba-3735-498d-9699-09b3dbe04561 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:34.954305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d478ba-3735-498d-9699-09b3dbe04561 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:34.954425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d478ba-3735-498d-9699-09b3dbe04561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:34.973598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:35.030188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-68d478ba-3735-498d-9699-09b3dbe04561 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:35.031417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-68d478ba-3735-498d-9699-09b3dbe04561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:35.140260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 696/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:35.292723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:35.294347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:35.422756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:35.464751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022b089-cb9c-4d95-a28f-1b670f3bb3ce None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:35.599037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:35.599815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:35.600076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:35.600531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:35.602209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:35.683655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:35.698037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:35.699685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d8489-a3f9-45ad-88c0-1f25c2625b26 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:35.718189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 729/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:41:36.606856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:36.607434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:36.607434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:36.608795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 697/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:36.615213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c152-26ee-47bc-9959-3f3ecee49e4d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:36.615657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c152-26ee-47bc-9959-3f3ecee49e4d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:36.615804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c152-26ee-47bc-9959-3f3ecee49e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:36.705876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-2ca7c152-26ee-47bc-9959-3f3ecee49e4d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:36.707369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2ca7c152-26ee-47bc-9959-3f3ecee49e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:36.820738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 730/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:36.972310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:36.974074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:37.063115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:37.132695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356f455-63b8-4def-96bd-6748f466c9ee None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:37.249966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:37.250622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:37.250919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:37.251192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:37.252898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:37.310899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:37.354957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:37.356593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116591fc-8d1a-48b0-93eb-67a68c86eb9a service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:37.374728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 698/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:38.215134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:38.215745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:38.215745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:38.217120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 731/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:38.222179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5eb0-93b4-4d78-a723-31ac44e222c2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:38.222622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5eb0-93b4-4d78-a723-31ac44e222c2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:38.222729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5eb0-93b4-4d78-a723-31ac44e222c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:38.304998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-793f5eb0-93b4-4d78-a723-31ac44e222c2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:38.306372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-793f5eb0-93b4-4d78-a723-31ac44e222c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:38.411134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 699/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:38.563549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:38.565368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:38.621635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:38.732109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7170-815e-4c28-acf3-606455e39a23 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:38.852724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:38.853277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:38.853559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:38.853836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:38.855541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:38.863008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:38.956184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:38.957779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883daa4-2f4d-43c8-8000-55a7969a6fc3 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:38.976192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 732/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:39.809465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:39.810046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:39.810243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:39.811584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 700/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:39.816744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc75-9062-4424-8df1-6884c57da6fd None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:39.817212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc75-9062-4424-8df1-6884c57da6fd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:39.817404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fc75-9062-4424-8df1-6884c57da6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:39.895946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e199fc75-9062-4424-8df1-6884c57da6fd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:39.897177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e199fc75-9062-4424-8df1-6884c57da6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:39.972801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:40.005517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 733/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:40.157992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:40.159848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:40.178215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:40.311092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdbba0-f173-4894-afd2-809772a122fa None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:40.405802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:40.432906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:40.433474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:40.433756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:40.434029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:40.435726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:40.532833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:40.533954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe360f2e-d91d-414c-acd0-e02326341a5f service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:40.553546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 701/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:41:41.373170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:41.373764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:41.373764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:41.375126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 734/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:41.380435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b319-1dcc-4903-9e4d-9b60675ff78b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:41.380920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b319-1dcc-4903-9e4d-9b60675ff78b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:41.381027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207b319-1dcc-4903-9e4d-9b60675ff78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:41.465276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8207b319-1dcc-4903-9e4d-9b60675ff78b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:41.466527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8207b319-1dcc-4903-9e4d-9b60675ff78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:41.509688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:41.570069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 702/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:41.724639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:41.726358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:41.915832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b49e3-e148-4d34-bfa4-339b7b0f6424 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:41.998157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:42.085329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:42.086342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:42.086774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:42.087189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:42.090065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:42.212207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:42.215071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2205bd-2109-4d7c-98b6-843ca52e8d5b service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:42.237961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 735/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:43.064607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:43.065264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:43.065264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:43.066519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 703/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:41:43.072026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04036-89f6-4a48-8d88-db09785a528a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:43.072468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04036-89f6-4a48-8d88-db09785a528a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:43.072658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04036-89f6-4a48-8d88-db09785a528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:43.150357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cee04036-89f6-4a48-8d88-db09785a528a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:43.151621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cee04036-89f6-4a48-8d88-db09785a528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:43.154968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:43.253402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 736/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:43.405986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:43.407475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:43.571146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe763e-a14b-4bc9-a5f7-60f2246cbd60 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:43.602588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:43.697524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:43.698179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:43.698458 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:43.698737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:43.700441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:43.796190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:43.797796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3715247-bc58-4395-bd93-79bf26b4d942 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:43.816817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 704/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:45.830854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:45.831427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:45.831427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:45.832786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 737/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:45.838777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7d77-ef1a-4c77-b853-83cee5857c5f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:45.839268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7d77-ef1a-4c77-b853-83cee5857c5f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:45.839579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7d77-ef1a-4c77-b853-83cee5857c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:45.881497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:45.909042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-833c7d77-ef1a-4c77-b853-83cee5857c5f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:45.910279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-833c7d77-ef1a-4c77-b853-83cee5857c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:46.014652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 705/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:46.057927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:46.059566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:46.197569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5bd8-f5e6-4263-a1d7-c7b9ee324277 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:46.234902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:46.284512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:46.285294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:46.285703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:46.286093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:46.288109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:46.423517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:46.425358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf39e8c-7aa5-4429-bdf0-179b02de1493 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:46.448142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 738/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:48.832411 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:48.832956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:48.832956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:48.834405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 706/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:48.840261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c128db-70ba-4fac-9eee-686698a57d66 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:48.840855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c128db-70ba-4fac-9eee-686698a57d66 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:48.840855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c128db-70ba-4fac-9eee-686698a57d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:48.908090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e4c128db-70ba-4fac-9eee-686698a57d66 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:48.909516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e4c128db-70ba-4fac-9eee-686698a57d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:48.926703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:49.014483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 739/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:49.053033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:49.054765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:49.163330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc961df-01e4-4ba6-89ea-fde22aab6719 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:49.175827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:49.246235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:49.246888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:49.247169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:49.247443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:49.249116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:49.360456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:49.361891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d18b-1284-437e-8b11-a34520a183ad service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:49.382259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 707/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:51.806148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:51.806737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:51.806737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:51.808140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 740/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:51.814068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90060-c6b9-4416-aef3-2fca9b66d400 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:51.814619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90060-c6b9-4416-aef3-2fca9b66d400 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:51.814619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90060-c6b9-4416-aef3-2fca9b66d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:51.865241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:51.884988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5ba90060-c6b9-4416-aef3-2fca9b66d400 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:51.886220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5ba90060-c6b9-4416-aef3-2fca9b66d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:51.988202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 708/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:52.027796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:52.029350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:52.152610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ed906-fcff-475d-a63c-af632dc5f1ed None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:52.195320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:52.232112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:52.232763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:52.233042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:52.233320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:52.235324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:52.348930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:52.350372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f9746-0b46-4e34-8163-dcc7d30ef237 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:52.369852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 741/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:54.605982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:54.606780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:54.606780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:54.607984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 709/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:54.613900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bb003-05c6-4613-a228-f1cc96a35efb None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:54.614374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bb003-05c6-4613-a228-f1cc96a35efb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:54.614480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bb003-05c6-4613-a228-f1cc96a35efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:54.682799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7e8bb003-05c6-4613-a228-f1cc96a35efb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:54.684049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7e8bb003-05c6-4613-a228-f1cc96a35efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:54.704759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:54.790126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 742/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:54.829793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:54.831749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:54.949777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec46d9-6baa-40cb-a3ac-70e760892b3c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:54.974185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:55.030684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:55.031326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:55.031639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:55.031919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:55.033595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:55.150300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:55.151391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763350-6a58-428d-b397-7700093bc233 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:55.170523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 710/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:41:57.396726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:57.397278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:57.397278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:57.398731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 743/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:41:57.404518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378dbbf-2637-433e-b8e6-4821c3d26f83 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:57.404987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378dbbf-2637-433e-b8e6-4821c3d26f83 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:57.405088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378dbbf-2637-433e-b8e6-4821c3d26f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:57.474954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:57.477972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f378dbbf-2637-433e-b8e6-4821c3d26f83 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:41:57.479918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f378dbbf-2637-433e-b8e6-4821c3d26f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:57.581327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 711/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:41:57.620614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:41:57.622187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:57.729801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f561-abc6-4d5c-8f70-5c3243fd8a80 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:41:57.783355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:41:57.811340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:41:57.812137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:41:57.812428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:41:57.812708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:41:57.814490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:41:57.949306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:41:57.950779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8e0a-2780-4127-a421-176fa6846fa1 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:41:57.972291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 744/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:00.221079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:00.221681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:00.221782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:00.224358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 712/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:00.230525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da50d5-f89a-4330-9a65-afedd3ac32a2 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:00.231264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da50d5-f89a-4330-9a65-afedd3ac32a2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:00.231264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da50d5-f89a-4330-9a65-afedd3ac32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:00.321651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a9da50d5-f89a-4330-9a65-afedd3ac32a2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:00.322882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a9da50d5-f89a-4330-9a65-afedd3ac32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:00.362335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:00.438929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 745/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:00.478612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:00.480502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:00.617171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ca077-64db-437e-991b-e1a9d772f434 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:00.650532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:00.704955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:00.705531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:00.705925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:00.706933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:00.708799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:00.829466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:00.832932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469962-5708-4b69-b2ac-663645554d0c service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:00.857551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 713/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:42:03.025546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:03.026160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:03.026160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:03.027488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 746/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:03.033233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc60-325f-40c2-9295-54a6cdd3d6c4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:03.033697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc60-325f-40c2-9295-54a6cdd3d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:03.033819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc60-325f-40c2-9295-54a6cdd3d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:03.098145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d9c2dc60-325f-40c2-9295-54a6cdd3d6c4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:03.099354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d9c2dc60-325f-40c2-9295-54a6cdd3d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:03.108599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:03.197936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 714/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:03.235645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:03.237545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:03.345409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981745-6166-4c81-ba5d-9865f8cf2bfa None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:03.400375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:03.419476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:03.420139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:03.420423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:03.420704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:03.422364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:03.534780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:03.536271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d624cb6-393b-4381-bf12-294f3c93051b service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:03.555019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 747/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:05.673495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:05.674662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:05.674662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:05.676080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 715/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:05.681319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853dbc-9e41-4a39-b4b5-1e3d52c717e6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:05.681779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853dbc-9e41-4a39-b4b5-1e3d52c717e6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:05.681878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11853dbc-9e41-4a39-b4b5-1e3d52c717e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:05.748565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-11853dbc-9e41-4a39-b4b5-1e3d52c717e6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:05.749802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-11853dbc-9e41-4a39-b4b5-1e3d52c717e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:05.788392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:05.848192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 748/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:05.885800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:05.887349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:05.992521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121f626-1ee8-456d-a1b9-4f8ca7edc423 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:06.030066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:06.069797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:06.070372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:06.070666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:06.070949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:06.072661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:06.194014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:06.195708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91b5e-5f05-4746-8c46-0dee5c933458 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:06.216108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 716/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:08.276019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:08.276632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:08.276632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:08.277972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 749/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:08.283910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870854b-16da-4fa4-83af-c8664bb61882 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:08.284374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870854b-16da-4fa4-83af-c8664bb61882 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:08.284478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870854b-16da-4fa4-83af-c8664bb61882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:08.348515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-9870854b-16da-4fa4-83af-c8664bb61882 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:08.349746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9870854b-16da-4fa4-83af-c8664bb61882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:08.367588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:08.446077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 717/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:08.483757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:08.485323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:08.593453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e1ee-fa7d-4935-b5ae-a8ee6b4be832 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:08.660749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:08.668212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:08.668867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:08.669156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:08.669436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:08.671091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:08.780429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:08.781925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc078a94-2b15-4c07-963a-1e27283ef3ca service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:08.801879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 750/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:10.939034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:10.939614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:10.939614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:10.941036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 718/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:10.949168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb4f4-2906-4b08-9740-41a0e90ca4c8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:10.949750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb4f4-2906-4b08-9740-41a0e90ca4c8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:10.949750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb4f4-2906-4b08-9740-41a0e90ca4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:11.025191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4b5bb4f4-2906-4b08-9740-41a0e90ca4c8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:11.026427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4b5bb4f4-2906-4b08-9740-41a0e90ca4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:11.078255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:11.133694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 751/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:11.171298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:11.173534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:11.290829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04745d61-47c1-4611-a75e-8057b5d821c2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:11.340956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:11.367568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:11.368217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:11.368499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:11.368771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:11.370405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:11.482384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:11.483972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2c17-dfed-4843-9b77-4e4e951853b3 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:11.503173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 719/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:42:21.131782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=22 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:21.500760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=66 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:31.697566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bc7-c9af-4adc-91af-f5aa78b63a04 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:31.698116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bc7-c9af-4adc-91af-f5aa78b63a04 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:31.698238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95bc7-c9af-4adc-91af-f5aa78b63a04 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:31.701317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 752/1471] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:31.706169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b883b-1d9a-4c4d-9f66-af8918308205 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:31.706803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b883b-1d9a-4c4d-9f66-af8918308205 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:31.706803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b883b-1d9a-4c4d-9f66-af8918308205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:31.793461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d76b883b-1d9a-4c4d-9f66-af8918308205 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:31.794729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d76b883b-1d9a-4c4d-9f66-af8918308205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:31.903319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 720/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:31.995964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:31.996749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:31.997041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:31.998426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 753/1473] 10.222.0.23 () {54 vars in 966 bytes} [Wed Jul 20 14:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:32.003602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a76-1594-46c5-8da1-6fbbc5ea2a81 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:32.003901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a76-1594-46c5-8da1-6fbbc5ea2a81 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:32.004187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe66a76-1594-46c5-8da1-6fbbc5ea2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:32.110561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2fe66a76-1594-46c5-8da1-6fbbc5ea2a81 None None] MFA Rules not processed for user `9fc7a82e40184ae28526ca41ddca25d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:32.111892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2fe66a76-1594-46c5-8da1-6fbbc5ea2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:32.135798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:32.215146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 721/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Wed Jul 20 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:32.219657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:32.221254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:32.330948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba344066-f064-4809-9678-4bd04a5708d0 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:32.412949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:32.413921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:32.414357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:32.414795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:32.417867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:32.484606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:32.549977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:32.551463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635323-bed3-43f1-972a-06f4a2f07ee8 service glance] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:32.570967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 754/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:34.802602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:34.803123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:34.803123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:34.804519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 722/1476] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:34.810618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6bf9-fc0a-4f0c-824a-d50a9c105a15 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:34.811106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6bf9-fc0a-4f0c-824a-d50a9c105a15 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:34.811209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6bf9-fc0a-4f0c-824a-d50a9c105a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:34.880286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f75e6bf9-fc0a-4f0c-824a-d50a9c105a15 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:34.881638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f75e6bf9-fc0a-4f0c-824a-d50a9c105a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:34.980726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 755/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:42:35.004396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:35.005978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:35.138809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbc0a2-1858-4a5f-95be-b3e74b324b8b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:35.188892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:35.237979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:35.238652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:35.238938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:35.239218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:35.240003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:35.241780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:42:35.241780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:42:35.241780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:42:35.242933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206ef4c-dd30-41a8-af93-4baae51d3021 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:35.264864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 723/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Jul 20 14:42:35 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:42:37.399475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:37.400076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:37.400076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:37.401420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 756/1479] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:37.407823 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845b8f-5279-4c52-9275-e59439ebb185 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:37.408326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845b8f-5279-4c52-9275-e59439ebb185 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:37.408436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845b8f-5279-4c52-9275-e59439ebb185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:37.477881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e6845b8f-5279-4c52-9275-e59439ebb185 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:37.479323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e6845b8f-5279-4c52-9275-e59439ebb185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:37.584400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 724/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:37.628718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:37.630274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:37.640755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:37.799331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09027-a890-4cea-a9ac-93f7d4b6beda None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:37.884468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:37.921233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:37.921908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:37.922192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:37.922469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:37.924255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:38.023103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:38.024795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ead53-166a-4392-aa1c-04cf739b4a18 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:38.044461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 757/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:40.307842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750647-da96-4545-b622-0dd32563b628 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:40.308477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750647-da96-4545-b622-0dd32563b628 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:40.308477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b750647-da96-4545-b622-0dd32563b628 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:40.309820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 725/1482] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:40.315616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361774-b91e-422d-8644-51e545f91d33 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:40.321639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361774-b91e-422d-8644-51e545f91d33 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:40.321639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef361774-b91e-422d-8644-51e545f91d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:40.390029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ef361774-b91e-422d-8644-51e545f91d33 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:40.392075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ef361774-b91e-422d-8644-51e545f91d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:40.447036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:40.505386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 758/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:40.543558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b750647-da96-4545-b622-0dd32563b628 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:40.545117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9b750647-da96-4545-b622-0dd32563b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:40.570013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:40.663320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b750647-da96-4545-b622-0dd32563b628 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:40.753046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:40.753705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:40.753991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:40.754268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:40.755998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:40.834624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:40.874290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:40.875787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dee270-46d8-4497-ba7f-2686e587d143 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:40.900660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 726/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:43.084366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:43.084958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:43.084958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:43.086324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 759/1485] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:43.092567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777810-9e5f-4a15-b894-b9faabcb7a77 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:43.093113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777810-9e5f-4a15-b894-b9faabcb7a77 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:43.093113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777810-9e5f-4a15-b894-b9faabcb7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:43.174610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2a777810-9e5f-4a15-b894-b9faabcb7a77 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:43.175877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2a777810-9e5f-4a15-b894-b9faabcb7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:43.280321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 727/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:43.320097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:43.321927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:43.444232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cf530-75e4-48c2-8df8-547f38cb7c2c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:43.524047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:43.526242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:43.526965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:43.527498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:43.527712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:43.530118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:43.656625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:43.658036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef50f3-ec2c-429e-9864-3675395a79fc service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:43.678427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 760/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:45.870538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:45.871117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:45.871117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:45.872555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 728/1488] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:45.878381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270480-92a9-4a86-9fb0-3408f0cc9fe8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:45.878909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270480-92a9-4a86-9fb0-3408f0cc9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:45.879017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270480-92a9-4a86-9fb0-3408f0cc9fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:45.964650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d2270480-92a9-4a86-9fb0-3408f0cc9fe8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:45.965908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d2270480-92a9-4a86-9fb0-3408f0cc9fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:46.022436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:46.070223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 761/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:46.113098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:46.114687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:46.154992 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:46.227577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da93cf-28ac-4920-919a-d362c8851e6b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:46.311793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:46.312457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:46.312748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:46.313030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:46.314705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:46.406874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:46.438821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:46.440308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777f4a-7107-452f-818b-45b5739745c1 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:46.460848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 729/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:48.884656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:48.885185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:48.885185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:48.886525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 762/1491] 10.222.0.23 () {54 vars in 926 bytes} [Wed Jul 20 14:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:42:48.892633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836eac-a2ec-427c-9f9e-fb3f43142458 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:48.893122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836eac-a2ec-427c-9f9e-fb3f43142458 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:48.893230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836eac-a2ec-427c-9f9e-fb3f43142458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:48.964827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5a836eac-a2ec-427c-9f9e-fb3f43142458 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:42:48.966087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5a836eac-a2ec-427c-9f9e-fb3f43142458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:49.078746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 730/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Jul 20 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:42:49.120986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:42:49.122572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:49.240194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d5bff-9dab-487c-b4f7-ab8e4a33f456 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:42:49.318481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:42:49.319135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:42:49.319427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:42:49.319738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:42:49.321447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:42:49.330813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:49.444216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:42:49.445891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9949930-f432-4b76-aeb8-521cd2aefc12 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:42:49.469336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 763/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:42:59.076546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=82 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:42:59.466090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=50 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:17.795972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:17.796572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:17.796572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:17.873919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:44:17.875149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:17.973499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 731/1494] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:44:17.982376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:17.982887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:17.982992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.059817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:44:18.061601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:18.161466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 764/1495] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:44:18.166253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.167520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:18.179582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c3be8-f2f1-4112-bc70-5b27c874f030 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:18.240058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:18.280000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:18.280670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:18.281040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:18.281423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.282210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:44:18.282531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:18.283594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:18.283594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:44:18.283594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:44:18.284489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:18.296894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 732/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:44:18.305184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.315215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b1b7e-c74b-45df-88e7-41ef574803ad None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:18.379408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:18.414505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:18.415174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:18.415475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:18.415771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.416473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:18.418295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:18.418295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:44:18.418295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:44:18.420138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:18.475473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 765/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:44:18 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:44:18.479833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.481350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:18.514969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071febd3-ea95-4512-8189-9653fdde3127 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:18.618472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:18.619813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:18.620105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:18.620393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.621140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:18.622163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:18.622163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:44:18.622163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:44:18.623385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:18.666439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 733/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:44:18 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:44:18.670728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.672305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:18.734892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb342-a41b-4f50-917e-5eb13730df73 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:18.822877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:18.835916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:18.836595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:18.836876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:18.837154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.837891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:18.838906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:18.838906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:44:18.838906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:44:18.839828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:18.853668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 766/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:44:18.857922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.859497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:18.871178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cf94d-ad39-4ada-9838-6fdc24eb5181 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:18.896588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:18.968179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:18.968854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:18.969132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:18.969403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:18.970132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:18.971137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:18.971137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:44:18.971137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:44:18.972047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4cbfb-0bd7-4bbd-ae61-00c500fa83c5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:18.984729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 734/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:44:18.989015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:18.990550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:19.025783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c65600-f2c2-4532-ae76-6622c0b48af9 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:19.123339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:19.124237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.124544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.124801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] PATH_INFO: `/v3/projects/4a5870253d81483abd7a1ea9be2058fe/users/5472b64792df474cb587771932b85766/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.150666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5870253d81483abd7a1ea9be2058fe, user_id=5472b64792df474cb587771932b85766, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:19.151763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:19.151763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:44:19.151763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:44:19.154145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fe25e-269f-4af2-8460-0a875b562692 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:19.180764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 767/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:44:18 2022] PUT /identity/v3/projects/4a5870253d81483abd7a1ea9be2058fe/users/5472b64792df474cb587771932b85766/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:44:19.193951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0b28-96be-4182-9a43-b94bedb46298 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.194247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0b28-96be-4182-9a43-b94bedb46298 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.194530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a0b28-96be-4182-9a43-b94bedb46298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.258047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5f2a0b28-96be-4182-9a43-b94bedb46298 None None] MFA Rules not processed for user `5472b64792df474cb587771932b85766`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:44:19.259874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5f2a0b28-96be-4182-9a43-b94bedb46298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:19.346865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 735/1502] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:44:19.361050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.361345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.361624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.363019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 768/1503] 10.222.0.23 () {54 vars in 964 bytes} [Wed Jul 20 14:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:44:19.368690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371fc-2ddb-4b58-9713-954b1d8b831f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.368989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371fc-2ddb-4b58-9713-954b1d8b831f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.369296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371fc-2ddb-4b58-9713-954b1d8b831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.402560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:19.452084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f7d371fc-2ddb-4b58-9713-954b1d8b831f None None] MFA Rules not processed for user `dae0c98ee06544579ca6cdbe1163a028`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:44:19.453419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f7d371fc-2ddb-4b58-9713-954b1d8b831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:19.547785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 736/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Wed Jul 20 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:44:19.557049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:19.558576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:19.615854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:19.679506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72fd7b-ee1c-4857-8a13-b9551fbf4bee None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:19.763668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:19.764527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.764899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.765282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.767372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:19.888210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:19.889801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:19.894129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:19.912889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 769/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:44:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:44:19.961971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f784-ffd2-41bb-8c29-4f4d0d4ff526 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:19.961971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f784-ffd2-41bb-8c29-4f4d0d4ff526 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:19.961971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f784-ffd2-41bb-8c29-4f4d0d4ff526 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:19.963470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 737/1506] 10.222.0.23 () {52 vars in 829 bytes} [Wed Jul 20 14:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:44:19.972479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:19.974635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:20.098499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd698-040c-4898-a0f2-3dfd3142bfd2 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:20.219583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:20.220530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:20.220817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:20.221098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] PATH_INFO: `/v3/users/5472b64792df474cb587771932b85766` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:20.237589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5472b64792df474cb587771932b85766)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:20.238669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:20.238669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:44:20.238669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:44:20.240156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:20.252172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:20.319351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5472b64792df474cb587771932b85766'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:20.334526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5472b64792df474cb587771932b85766'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:20.357905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5472b64792df474cb587771932b85766'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:20.372027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5472b64792df474cb587771932b85766'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:20.372914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5472b64792df474cb587771932b85766'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:20.379150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 770/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:44:19 2022] DELETE /identity/v3/users/5472b64792df474cb587771932b85766 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:44:20.383828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:20.384123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:20.384407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:20.443999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:44:20.445234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:20.536241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:20.557925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 738/1508] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:44:20.570582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:20.571914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:20.692658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd4521-ea46-45f3-9b86-3d4dde1bdbc0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:20.750815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:20.777869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:20.778627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:20.778912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:20.779216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:20.780928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:20.908752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:20.911444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b61e1-12cb-4e28-b8d6-dca76b587406 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:21.063951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 771/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:44:21.444028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:44:21.445264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:44:21.458025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723616a5-8a86-439a-a392-a7c3157c8154 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:44:21.579314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:44:21.580223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:44:21.580507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:44:21.580784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] PATH_INFO: `/v3/projects/4a5870253d81483abd7a1ea9be2058fe` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:44:21.591831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5870253d81483abd7a1ea9be2058fe)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:44:21.592887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:44:21.592887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:44:21.592887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:44:21.594105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:44:21.661199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5870253d81483abd7a1ea9be2058fe', 'request_id': 'req-70888776-de22-4a0f-9a46-3e22de8f0d61'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:21.683150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5870253d81483abd7a1ea9be2058fe', 'request_id': 'req-70888776-de22-4a0f-9a46-3e22de8f0d61'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:21.691219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5870253d81483abd7a1ea9be2058fe', 'request_id': 'req-70888776-de22-4a0f-9a46-3e22de8f0d61'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:21.731869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] The token cache is being invalidate because project 4a5870253d81483abd7a1ea9be2058fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:44:21.732480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:21.733196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-70888776-de22-4a0f-9a46-3e22de8f0d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:44:21.735813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 739/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:44:21 2022] DELETE /identity/v3/projects/4a5870253d81483abd7a1ea9be2058fe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:44:31.061140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=62 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:44:31.723664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:46:17.175968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:17.176617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:17.176617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:17.177892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 772/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:17.183316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e860a0-3f1f-4c28-9ad4-5e979590997e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:17.183907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e860a0-3f1f-4c28-9ad4-5e979590997e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:17.183907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e860a0-3f1f-4c28-9ad4-5e979590997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:17.280300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-21e860a0-3f1f-4c28-9ad4-5e979590997e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:17.281604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-21e860a0-3f1f-4c28-9ad4-5e979590997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:17.403237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 740/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:46:17.559817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:17.562108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:17.686184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fddb1-cb00-4732-83b9-72e387e62a28 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:17.691784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:17.692430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:17.692714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:17.692993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:17.704575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:17.706185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae399d-5c32-46ce-a4b4-d4d1b6925ffb service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:17.717639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 773/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:46:18.568568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d12-7124-4da2-ac6e-0d68412c349d None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:18.569185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d12-7124-4da2-ac6e-0d68412c349d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:18.569185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154d12-7124-4da2-ac6e-0d68412c349d None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:18.570515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 741/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:18.576190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d222-1db7-4014-8d56-dfeee3343131 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:18.576789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d222-1db7-4014-8d56-dfeee3343131 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:18.576789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89d222-1db7-4014-8d56-dfeee3343131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:18.597244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-bf89d222-1db7-4014-8d56-dfeee3343131 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:18.598532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bf89d222-1db7-4014-8d56-dfeee3343131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:18.610244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 774/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:18.768902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154d12-7124-4da2-ac6e-0d68412c349d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:18.787002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154d12-7124-4da2-ac6e-0d68412c349d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:18.792480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:18.793130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:18.793965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:18.794213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:18.803102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:18.804818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3887c6-2084-4900-b8a2-44936cd21e33 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:18.815244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 742/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:19.098815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8d22-5a3d-4913-842e-9f04191071e9 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:19.099027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8d22-5a3d-4913-842e-9f04191071e9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:19.099290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8d22-5a3d-4913-842e-9f04191071e9 None None] PATH_INFO: `/v3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:19.100648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 775/1517] 10.222.0.74 () {54 vars in 925 bytes} [Wed Jul 20 14:46:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:46:19.107470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e8d9-a4b4-4485-9903-e833abf0e131 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:19.107786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e8d9-a4b4-4485-9903-e833abf0e131 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:19.108050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e8d9-a4b4-4485-9903-e833abf0e131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:19.166265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1da5e8d9-a4b4-4485-9903-e833abf0e131 None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:19.167488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1da5e8d9-a4b4-4485-9903-e833abf0e131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:19.185818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:46:19.242451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 743/1518] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Jul 20 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:23.151623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b14f-7e4d-4b8c-b4f6-60c26259a952 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:23.152161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b14f-7e4d-4b8c-b4f6-60c26259a952 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:23.152161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b14f-7e4d-4b8c-b4f6-60c26259a952 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:23.153494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 776/1519] 10.222.0.23 () {54 vars in 961 bytes} [Wed Jul 20 14:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:23.158802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782febe-fa13-446a-a12b-8ee88c3fbeb4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:23.159292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782febe-fa13-446a-a12b-8ee88c3fbeb4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:23.159401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782febe-fa13-446a-a12b-8ee88c3fbeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:23.177898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1782febe-fa13-446a-a12b-8ee88c3fbeb4 None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:23.179074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1782febe-fa13-446a-a12b-8ee88c3fbeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:23.188540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 744/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Jul 20 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:23.196187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b14f-7e4d-4b8c-b4f6-60c26259a952 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:23.209578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b14f-7e4d-4b8c-b4f6-60c26259a952 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:23.214756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:23.215387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:23.215702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:23.215980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:23.224527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:23.226114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bbd0d-2008-43bb-a86c-8c7825184817 service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:23.245068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 777/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:30.056993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ce2-2c18-4f7c-a3ff-18b04aa7b234 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:30.057579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ce2-2c18-4f7c-a3ff-18b04aa7b234 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:30.057579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9ce2-2c18-4f7c-a3ff-18b04aa7b234 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:30.059423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 745/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:30.064945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f086a-d359-4bab-9fcd-0e1e49b8ba15 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:30.065396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f086a-d359-4bab-9fcd-0e1e49b8ba15 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:30.065528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f086a-d359-4bab-9fcd-0e1e49b8ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:30.084673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4c7f086a-d359-4bab-9fcd-0e1e49b8ba15 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:30.085913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4c7f086a-d359-4bab-9fcd-0e1e49b8ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:30.094325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 778/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:46:30.256922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9ce2-2c18-4f7c-a3ff-18b04aa7b234 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:30.272946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9ce2-2c18-4f7c-a3ff-18b04aa7b234 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:30.278979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:30.279681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:30.279969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:30.280251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:30.289570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:30.291183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde17c95-ea36-4499-87d4-e9ea9da6a03b service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:30.301638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 746/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:31.154426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd933-6541-452b-b63a-75ab2efd2892 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:31.155009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd933-6541-452b-b63a-75ab2efd2892 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:31.155009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcd933-6541-452b-b63a-75ab2efd2892 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:31.156407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 779/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 14:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:31.161336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9f6a-f830-429c-aaa1-778ad3684522 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:31.161802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9f6a-f830-429c-aaa1-778ad3684522 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:31.161938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b9f6a-f830-429c-aaa1-778ad3684522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:31.180075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-489b9f6a-f830-429c-aaa1-778ad3684522 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:31.181313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-489b9f6a-f830-429c-aaa1-778ad3684522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:31.190371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 747/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 14:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:31.343826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd933-6541-452b-b63a-75ab2efd2892 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:31.359383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcd933-6541-452b-b63a-75ab2efd2892 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:31.365196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:31.365848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:31.366127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:31.366408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:31.376198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:31.377805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bd584-1aa7-4ebc-b437-f812418bbef8 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:31.387796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 780/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:35.787910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:35.788456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:35.788456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:35.789809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 748/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:35.795303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340b025-0190-4e46-9473-e0319b1fbaac None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:35.795813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340b025-0190-4e46-9473-e0319b1fbaac None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:35.795927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340b025-0190-4e46-9473-e0319b1fbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:35.814348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-3340b025-0190-4e46-9473-e0319b1fbaac None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:35.815630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3340b025-0190-4e46-9473-e0319b1fbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:35.823700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 781/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:35.904515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:35.907082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:36.000038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4af44f-a038-4e8f-8d4a-a41ce399e8bc None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:36.003733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:36.004389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:36.004684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:36.004965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:36.015327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:36.016827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39568688-b4db-4a93-9245-b520e9cc5770 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:36.026883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 749/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:38.095096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008233ba-6704-434e-8ce2-192482091e58 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:38.095699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008233ba-6704-434e-8ce2-192482091e58 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:38.095798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008233ba-6704-434e-8ce2-192482091e58 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:38.097137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 782/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:38.102785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1de20-580e-48ea-9f75-2d40270e445f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:38.103238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1de20-580e-48ea-9f75-2d40270e445f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:38.103343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1de20-580e-48ea-9f75-2d40270e445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:38.121528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8ae1de20-580e-48ea-9f75-2d40270e445f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:38.122755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8ae1de20-580e-48ea-9f75-2d40270e445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:38.131391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 750/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:38.169600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008233ba-6704-434e-8ce2-192482091e58 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:38.171319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-008233ba-6704-434e-8ce2-192482091e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:38.184238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008233ba-6704-434e-8ce2-192482091e58 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:38.187822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:38.188457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:38.188737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:38.189016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:38.203516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:38.204950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeb5b4-7564-46a0-86f2-d054ce7c538f service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:38.215505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 783/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:42.625080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:42.625650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:42.625650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:42.627007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 751/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:42.632273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921db9-3f41-4a82-a4c5-f2b4df5aff6f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:42.632739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921db9-3f41-4a82-a4c5-f2b4df5aff6f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:42.632837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921db9-3f41-4a82-a4c5-f2b4df5aff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:42.639156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=81 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:46:42.652164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-43921db9-3f41-4a82-a4c5-f2b4df5aff6f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:42.653385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-43921db9-3f41-4a82-a4c5-f2b4df5aff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:42.661422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 784/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:42.967566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:42.969251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:43.042801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:46:43.056799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a866d-0db2-426e-a60b-08edcf7ce722 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:43.060957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:43.061604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:43.061889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:43.062164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:43.071412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:43.072872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8666-8334-4400-a81a-f565d8da5634 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:43.082872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 752/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:45.160575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:45.161131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:45.161131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:45.162561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 785/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 14:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:46:45.168869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507096-0de6-4e7b-9460-38b9407777f3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:45.169360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507096-0de6-4e7b-9460-38b9407777f3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:45.169467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7507096-0de6-4e7b-9460-38b9407777f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:45.187367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a7507096-0de6-4e7b-9460-38b9407777f3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:46:45.188582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a7507096-0de6-4e7b-9460-38b9407777f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:45.196432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 753/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:46:45.511816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:46:45.513549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:46:45.528218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e65cd-d46f-42dd-8cea-2c6126b378cf None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:46:45.533407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:46:45.534478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:46:45.534974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:46:45.535498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:46:45.546485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:46:45.548001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb754a8f-9728-4b02-a609-826b8fa92613 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:46:45.558510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 786/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:46:55.182695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=11 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:46:55.553911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=8 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:29.355245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912a7-97c7-4ca4-b27d-de2686e0050c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.355921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912a7-97c7-4ca4-b27d-de2686e0050c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.356314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912a7-97c7-4ca4-b27d-de2686e0050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.374836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676baa49-04f9-4cb7-8052-015b66f7d862 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.375890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676baa49-04f9-4cb7-8052-015b66f7d862 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.376406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676baa49-04f9-4cb7-8052-015b66f7d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.387506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-519912a7-97c7-4ca4-b27d-de2686e0050c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.388762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-519912a7-97c7-4ca4-b27d-de2686e0050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.403941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 754/1540] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.405515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e3ab-0fd2-421b-890d-da853aad923c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.405814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e3ab-0fd2-421b-890d-da853aad923c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.406100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2e3ab-0fd2-421b-890d-da853aad923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.418227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-676baa49-04f9-4cb7-8052-015b66f7d862 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.419885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-676baa49-04f9-4cb7-8052-015b66f7d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.435821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 787/1541] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:29.438198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410de53-61ef-4360-ac3e-5e593b3a5d71 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.438820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410de53-61ef-4360-ac3e-5e593b3a5d71 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.439334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410de53-61ef-4360-ac3e-5e593b3a5d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.444638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-aba2e3ab-0fd2-421b-890d-da853aad923c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.445869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-aba2e3ab-0fd2-421b-890d-da853aad923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.474966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c410de53-61ef-4360-ac3e-5e593b3a5d71 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.475178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 755/1542] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.476930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c410de53-61ef-4360-ac3e-5e593b3a5d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.482874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31747c-953b-47f5-ae2b-cb870c883551 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.482874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31747c-953b-47f5-ae2b-cb870c883551 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.482874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31747c-953b-47f5-ae2b-cb870c883551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.495697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 788/1543] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.497612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.498151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.498671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.538189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-af31747c-953b-47f5-ae2b-cb870c883551 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.539495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-af31747c-953b-47f5-ae2b-cb870c883551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.542237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.543258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.569337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 756/1544] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.570481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6579a2-e0cc-43d6-af27-40d22709ee30 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.570777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6579a2-e0cc-43d6-af27-40d22709ee30 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.571062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6579a2-e0cc-43d6-af27-40d22709ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.581179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 789/1545] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.581875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.605755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124e27-f5b8-448a-bd6b-ecf9c9f49d08 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.615194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ad6579a2-e0cc-43d6-af27-40d22709ee30 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.616118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.616922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.617232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.617537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.618217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:29.619073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.621018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ad6579a2-e0cc-43d6-af27-40d22709ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.622153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:29.622153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:48:29.622153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:48:29.623049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.645756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 790/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:29.647683 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.651863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 757/1547] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.657660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.658027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.658306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.669116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce66b-edc2-4a4c-a676-f10b9c99bc42 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.682684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.684267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.685048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.685787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.687350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:29.688222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.693205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9fed-198a-4a45-b718-f7e3f416c5c8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.728714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.732432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 791/1548] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:29.732610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.734644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.735135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.735653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.748560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 758/1549] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.750053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.765764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.766243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f6790-8075-48f2-9b1d-206d6dbe44a5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.767170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.772137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.773170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.773662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.774166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.775765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.777050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:29.777050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:48:29.777050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:48:29.777575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 792/1550] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.778022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.779078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bdc61-7cc8-4007-9fdf-0d6429db3afc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.793691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf24f-0cc8-460f-996f-c4cdcf72304a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.799351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.800067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.800376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.800635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.801451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:29.801763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.803392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b37e47-26e3-43a8-a203-74f2139ac213 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.816833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 793/1551] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:29.818046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05372-2e7e-432f-b814-306e9036431d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.818386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05372-2e7e-432f-b814-306e9036431d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.818677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a05372-2e7e-432f-b814-306e9036431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.837898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 759/1552] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:29.839322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.840024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.840320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.845735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-57a05372-2e7e-432f-b814-306e9036431d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.846959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-57a05372-2e7e-432f-b814-306e9036431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.861119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:29.862355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:29.921793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 794/1553] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.922655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05372-2e7e-432f-b814-306e9036431d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.940379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 760/1554] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:29.940379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:29.941681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a05372-2e7e-432f-b814-306e9036431d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.947205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.947819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.948104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.948382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.949180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.950870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33671612-03eb-4d75-9d9c-1e1299bb1110 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:29.951050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.955955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:29.956670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.956961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.957247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:29.958103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:29.958431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:29.960207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf78f1-5136-4647-aefc-1dd46c9ca268 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:29.973735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 761/1555] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:29.974899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160543a4-182e-407c-9a18-5f666a2d80f6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:29.975193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160543a4-182e-407c-9a18-5f666a2d80f6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:29.975930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160543a4-182e-407c-9a18-5f666a2d80f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.004256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 795/1556] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.004256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.004592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-160543a4-182e-407c-9a18-5f666a2d80f6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:30.004592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-160543a4-182e-407c-9a18-5f666a2d80f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:30.069800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99717a-a593-4601-9029-3e78ecf6b3b0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.074385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 762/1557] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:30.075739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.076031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.076311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.076450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.077478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.077975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.078470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.082663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.083175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0ea8f-1f33-47ab-8b18-4e02b8f53e2a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.099770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:30.101058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:30.114293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 763/1558] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:30.115832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.124651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:30.132874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae859e-7ea0-44bf-a4ab-c9858737751d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.133676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 796/1559] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:29 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.135905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655eab6-b395-4833-b07c-0f63f33cfce8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.136194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655eab6-b395-4833-b07c-0f63f33cfce8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.136469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655eab6-b395-4833-b07c-0f63f33cfce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.160882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:30.161751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f655eab6-b395-4833-b07c-0f63f33cfce8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:30.162953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f655eab6-b395-4833-b07c-0f63f33cfce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:30.222231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.223174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.223674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.224122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.225335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.228549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.239608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 797/1560] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:30.241793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.242351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.242818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.255926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 764/1561] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.257113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.265276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:30.266515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:30.269061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a2990-b277-4b94-953b-00285b8a46df admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.273741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.274428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.274729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.275009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.275471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 798/1562] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:30.275920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.276316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.277855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.291299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854dfaa-bb2f-4b5f-9ecc-16872949d529 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.297259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.298152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.298448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.298730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.299442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.300536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:30.300536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:48:30.300536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:48:30.302063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeff16-6e70-41be-9873-404805ae5712 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.308130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 765/1563] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.308980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.331476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 799/1564] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.331476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.331476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.331476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.351533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:30.353433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:30.405518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b6dcc-b2b7-43ee-b838-df885649a06f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.412554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.413247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.413700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.413986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.416115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:30.418391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.419170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.434872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 800/1565] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:30.435801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.442956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 766/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:30.442956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.450865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7dfbf-a667-446b-be23-751ca5498b54 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.454168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998583d7-b3c3-45c5-bf02-ad5ee4a55fff admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.456060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.456738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.457019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.457293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.457998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.458887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.459592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.459880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.459975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.460160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.460904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:30.461219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.462870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.484501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 767/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:30.484501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.484822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 801/1568] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.485728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.491204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a356941-e3be-4d37-99ac-15f85dc6ef02 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.497448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.497951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9f13-b340-4a3c-bd46-3878a8f69ee0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.498134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.498428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.498711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.499479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.501120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.502817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.503509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.503799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.504076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.504830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:30.505190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.507351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.512105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 768/1569] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.515290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.523052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db926-5c1c-41dd-a105-a5e42dcd1a0a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.527371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 802/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:30.528280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.532956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.534324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.534817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.535826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.536612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.538970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.539249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451b4f1-997b-4419-b541-dc2812138d26 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.544487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.545170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.545438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.545717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.546455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.548194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.563818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 803/1571] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.563818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.566950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 769/1572] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.567671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.575713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3c517-a82a-4c5c-9dbb-ebe888f719c8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.577568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8b55-9157-4368-be73-c550c24d7d6a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.580526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.581193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.581617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.581922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.582604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.582720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:30.582964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.583263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.583587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.583876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.584613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.584722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.586534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.598349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 804/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:30.599026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.611644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27a79-0359-4e8d-9e06-9cd76660ded4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.616686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.620156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 770/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.620273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.620273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.620439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.620524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.620524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.620858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.639034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:30.642104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:30.656074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 805/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.656074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.687690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f3c2-ce5c-4c64-a272-57b839077a23 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.745420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d05a-3276-408f-8891-65d270fb088c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.751487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.751487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.751487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.751894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.753024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.754990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.761448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.762157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.762440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.762714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.763470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.765287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.767652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 806/1576] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.768568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.778247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 771/1577] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.779603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.787094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69d25-034e-46e0-a1ae-5ae4c406ed67 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.790974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914ca17-07ba-48ec-ab9d-6d58ccbfef09 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.792836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.793568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.793859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.794144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.795148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.795834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.796494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.796777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.797058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.797273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.797787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.799367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.811032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 772/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.811935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.822814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b483a5-40f1-4742-8ca7-db3d81611d5b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.830869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 807/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.831053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.831053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.831244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.831346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.831346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.831346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.831655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.843747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 773/1580] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:30.844841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.857912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1e6-11cf-422e-8f78-967df0f53ac9 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.897341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eff17c-eb0b-497a-bf35-0d767a33c6a3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.903155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.903889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.904174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.904478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.905176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.907219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.918259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:30.918937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:30.919220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:30.919523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:30.920238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:30.922144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:30.936123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 808/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.937113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.947871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 774/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:30.947871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:30.956001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80da6-b1ab-431e-8d3d-922ebb62e81b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:30.985837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.006115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.010567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc99-1486-48c6-bcb0-3de6335cd71d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.016743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.017418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.017700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.017977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.018678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.020652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.022979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.023910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.024193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.024471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] PATH_INFO: `/v3/projects/26f65043912b45ecb11495dfd8e85e0d/users/5e3cd85d98764256ac7988b738874634/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.040919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f65043912b45ecb11495dfd8e85e0d, user_id=5e3cd85d98764256ac7988b738874634, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.041968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:31.041968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:48:31.041968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:48:31.045669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 809/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:30 2022] POST /identity/v3/users => generated 278 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:31.045669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.045894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.054245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f07fa9-c91b-445f-ab8b-58a2f35805fa admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.058428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 775/1584] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:30 2022] PUT /identity/v3/projects/26f65043912b45ecb11495dfd8e85e0d/users/5e3cd85d98764256ac7988b738874634/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.059247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.113155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.114300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.114814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.115298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.116762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.119903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.132463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 810/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.133727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.146870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c79ea-5547-4140-8801-70dac8d7e497 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.147224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e960b-dda0-4d8d-af12-c2d422ac7955 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.151766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.152567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.152895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.153242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.153983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.155170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.156064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.156200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.156659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.156947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] PATH_INFO: `/v3/projects/e264ecc42d2f4deaae8b19484cd0e153/users/b917fb517461496885f5c5dfb6a0b207/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.174939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e264ecc42d2f4deaae8b19484cd0e153, user_id=b917fb517461496885f5c5dfb6a0b207, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.177926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.178749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 811/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:31.179766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.190973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14718624-7a13-43c2-a945-22af220e1de4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.198124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 776/1587] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:31 2022] PUT /identity/v3/projects/e264ecc42d2f4deaae8b19484cd0e153/users/b917fb517461496885f5c5dfb6a0b207/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.202429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.253195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.254018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.254256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.254556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.255327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.257117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.262514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18b5db-ac45-48f8-ae6e-51844c7a7c1a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.267441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.267879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 812/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.268146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.268431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.268697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.268798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.269397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.271350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.281098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac90c6-4881-4c4a-9cf2-a64b579b1d94 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.286105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.286825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.287118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.287402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.288165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.289773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd68e3d-b8d6-42b6-a910-f096913d5946 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.292612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 777/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:31.293504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.301014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 813/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.302581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f34-e860-465e-b87c-d7680306a350 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.302873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f34-e860-465e-b87c-d7680306a350 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.303150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f34-e860-465e-b87c-d7680306a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.308088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc5f1-c345-412f-9d52-d3d276441cb7 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.313104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.313894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.314254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.314609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.315427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.317075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.330747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 778/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.330747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.330998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8a669f34-e860-465e-b87c-d7680306a350 None None] MFA Rules not processed for user `5e3cd85d98764256ac7988b738874634`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:31.331469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8a669f34-e860-465e-b87c-d7680306a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:31.339419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d521-9e41-4c88-8604-5692e7e3c749 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.344430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.345309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.345616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.345903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] PATH_INFO: `/v3/projects/3263f4157b784011b02fef1e1f285345/users/9c158757829f47a2b698f86eb682430d/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.354629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.362669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3263f4157b784011b02fef1e1f285345, user_id=9c158757829f47a2b698f86eb682430d, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.365839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.375606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.380271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 779/1592] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:31 2022] PUT /identity/v3/projects/3263f4157b784011b02fef1e1f285345/users/9c158757829f47a2b698f86eb682430d/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.381097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.408931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 814/1593] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:31.408931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.408931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.408931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.424856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:31.426140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:31.445358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f3269-6391-402d-9c94-0b3541f5b6d2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.451342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.452081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.452378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.452660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.453400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.455021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.468750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 780/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.468750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.480658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f906818-c678-4532-b838-299ea3ac13cc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.486007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.487024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.487562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.488933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 815/1595] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:31.490067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.491764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] PATH_INFO: `/v3/projects/92e8a733299b46399cc6b97fe039cd73/users/f435520f0ee748f1bac962c6b8051f9e/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.500905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0ea6-32e3-4303-913b-0d1b05b0bb97 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.511278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.512058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.512454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.512735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.513559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e8a733299b46399cc6b97fe039cd73, user_id=f435520f0ee748f1bac962c6b8051f9e, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.513675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.515209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.516425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.527478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 816/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.528165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.536871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 781/1597] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:31 2022] PUT /identity/v3/projects/92e8a733299b46399cc6b97fe039cd73/users/f435520f0ee748f1bac962c6b8051f9e/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.537671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.540996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9c2e8-c3fe-4773-a079-de1ab6053646 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.601172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.601850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.602133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.602430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.603230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.604477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1adbe-249b-44d0-b679-0f13c2dbb8d3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.605451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e399a7-9ddc-4086-85da-562fb0897a45 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.609558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.610234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.610523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.610808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.611583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.613192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.614825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 817/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.616117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.616417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.616687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.628147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 782/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.628147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.635286 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:31.636283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3db4-d1e7-4b4a-9b34-898495210a53 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.636526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:31.641001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.641968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.642256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.642533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.643234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.644599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 818/1600] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:31.647807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.647926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.657046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1764f-67b7-469c-aa43-8b6734a31260 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.662078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.662635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.663065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.663394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.664219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.666014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.677575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 783/1601] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:31.677575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.685117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 819/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.685117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.693403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15fdfd-38c7-4670-bfa2-56d859265397 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.719929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.747260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a71b-c161-44cf-833b-3df5a9d4597a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.751526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.752184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.752470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.752753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.755882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:31.772495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.773721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.773721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.774035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.774607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.777063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a6cb5-b1ad-4750-8e5c-1b9b6bea91bf admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.789038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 820/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:31.790891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.791177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.791479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.812798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:31.814239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:31.822335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 821/1604] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:31.823142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.833508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bca97-0fae-4215-99e2-afefcadf17d9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.839377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.840600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.840884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.841162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] PATH_INFO: `/v3/projects/b64ae384481e48469c50e900ac7473da/users/5d0090359d7c46038b82bbb903abab93/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.843147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.844638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.856455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 784/1605] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:31.857292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.868133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79743a-03d1-4e58-a939-59e6995a879e service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:31.871679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64ae384481e48469c50e900ac7473da, user_id=5d0090359d7c46038b82bbb903abab93, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.877624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.878359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:31.879185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:31.879488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:31.879771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] PATH_INFO: `/v3/projects/461587b203c4417b864f9d68481251d6/users/d610eeb047b643bdbf18ed716714df39/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:31.896240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 822/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:31 2022] PUT /identity/v3/projects/b64ae384481e48469c50e900ac7473da/users/5d0090359d7c46038b82bbb903abab93/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.897114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.906395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] RBAC: Authorizing `identity:create_grant(project_id=461587b203c4417b864f9d68481251d6, user_id=d610eeb047b643bdbf18ed716714df39, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:31.910196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:31.933337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 785/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:31 2022] PUT /identity/v3/projects/461587b203c4417b864f9d68481251d6/users/d610eeb047b643bdbf18ed716714df39/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:31.933868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:31.973311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288bb0f-50f6-4721-ab63-5e1a79340cf0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.028564 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8f0b-72ff-46a1-9e79-cdda54b9413b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.031575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.032426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.032808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.033104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.035792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.036726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.037196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.037660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.038580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.044279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.045047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.045785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.061273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 823/1608] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:32.062857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.074619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 786/1609] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:31 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:32.076144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.076570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efad98-7bc0-4726-8043-d23384bce9ca service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.084325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.085476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.086073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.086324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] PATH_INFO: `/v3/projects/11ff216a65e8488baf25c661b8e609ed/users/f8152a5e47804a159b6271a075ef10d7/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.092846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c24be-cc7e-4a39-bbb9-6cf422813cca admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.100996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.101869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.102188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.102587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] PATH_INFO: `/v3/projects/4646536c1ac1402eada52ae90ca3d1e8/users/485531dc25a54d6ea00e28f93030b5a8/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.122718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ff216a65e8488baf25c661b8e609ed, user_id=f8152a5e47804a159b6271a075ef10d7, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.125672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.125917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4646536c1ac1402eada52ae90ca3d1e8, user_id=485531dc25a54d6ea00e28f93030b5a8, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.128980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72edc-734a-4aaa-b7d3-7888118e4530 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.143962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 824/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:32 2022] PUT /identity/v3/projects/11ff216a65e8488baf25c661b8e609ed/users/f8152a5e47804a159b6271a075ef10d7/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:32.145202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.152741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 787/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:32 2022] PUT /identity/v3/projects/4646536c1ac1402eada52ae90ca3d1e8/users/485531dc25a54d6ea00e28f93030b5a8/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:32.155475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7205b-87bb-4efe-8208-7c7046e6f2f0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.156145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7205b-87bb-4efe-8208-7c7046e6f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.157568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7205b-87bb-4efe-8208-7c7046e6f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.179907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e7f7205b-87bb-4efe-8208-7c7046e6f2f0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:32.180866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e7f7205b-87bb-4efe-8208-7c7046e6f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:32.200694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:32.213904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:32.221118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7c48-d324-49bb-a5cc-557c62ae9e32 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.258291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 788/1612] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:32.258291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576b57-5a45-4f17-b96f-f052c70b22d9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.258291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576b57-5a45-4f17-b96f-f052c70b22d9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.258291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58576b57-5a45-4f17-b96f-f052c70b22d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.292489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-58576b57-5a45-4f17-b96f-f052c70b22d9 None None] MFA Rules not processed for user `d610eeb047b643bdbf18ed716714df39`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:32.293719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-58576b57-5a45-4f17-b96f-f052c70b22d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:32.310944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.312034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.312565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.312986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.331369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.332862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.345151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 825/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:32.345370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.356338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56381-7aa3-4f27-b698-58af38a9c053 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.372728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.373425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.373837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.373981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.374969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.376741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ed365-f83b-4321-8dde-6fe2e075b264 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.404224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 826/1614] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:32.404224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653d22-278d-458c-8339-98af12f63252 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.404224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653d22-278d-458c-8339-98af12f63252 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.404224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653d22-278d-458c-8339-98af12f63252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.412765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 789/1615] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:32.414480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.415105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.415926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.464937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d1653d22-278d-458c-8339-98af12f63252 None None] MFA Rules not processed for user `f8152a5e47804a159b6271a075ef10d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:32.466398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d1653d22-278d-458c-8339-98af12f63252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:32.480342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] MFA Rules not processed for user `485531dc25a54d6ea00e28f93030b5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:32.481590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:32.572269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 827/1616] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:32.573328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653d22-278d-458c-8339-98af12f63252 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.619004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653d22-278d-458c-8339-98af12f63252 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.630756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.633219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.634827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.635135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.636259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 790/1617] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:32.638112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.662876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde45edf-2faf-4807-915a-3b4b13f71c10 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.667568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.670107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.672911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.674623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.675366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.675995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] PATH_INFO: `/v3/projects/aefa56f170cd45f1819cb356481c5e67/users/4e8eda99fafd4478a2589bbe6e280225/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.685701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 828/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:32.686808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.701187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2a504-49de-4866-aa3b-c48c2ef6e2f9 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.704797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefa56f170cd45f1819cb356481c5e67, user_id=4e8eda99fafd4478a2589bbe6e280225, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.707494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.708212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.708388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.708586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.708874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.709654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.711971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2101b-4dba-4f25-a85a-2565cb960781 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.733961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 791/1619] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:32 2022] PUT /identity/v3/projects/aefa56f170cd45f1819cb356481c5e67/users/4e8eda99fafd4478a2589bbe6e280225/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:32.735175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.751388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 829/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:32.753297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9492a-ba3c-40c0-a56a-ed1e21c1bb83 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.753792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9492a-ba3c-40c0-a56a-ed1e21c1bb83 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.754239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9492a-ba3c-40c0-a56a-ed1e21c1bb83 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.762354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 830/1621] 10.222.0.23 () {54 vars in 962 bytes} [Wed Jul 20 14:48:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:32.763467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9492a-ba3c-40c0-a56a-ed1e21c1bb83 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.774512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:32.829810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8feab-9e0e-4254-ae43-c2227f440829 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.834690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:32.853244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9492a-ba3c-40c0-a56a-ed1e21c1bb83 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.859506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.860674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.861151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.861612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.862956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.864740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.879410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 831/1622] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:32.880748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:32.903986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238b48b-419e-44f6-9243-80ce0d39ecc6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:32.912531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.913399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.913693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.914095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.915913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.916561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:32.917324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.917615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.918006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.918616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1c09-1626-4b6a-8094-710e9c9dabc8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.918859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:32.921532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:32.951679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 832/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/users => generated 284 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:32.953859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:32.954188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:32.954567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:32.968559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 792/1624] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:32.970073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.015072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:33.016516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:33.111969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 833/1625] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Jul 20 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:33.113438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.125765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8054cab-c148-4616-90a9-5876e920c124 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.136331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.138111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.138732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.139274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] PATH_INFO: `/v3/projects/aefa56f170cd45f1819cb356481c5e67/users/4e8eda99fafd4478a2589bbe6e280225/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.143741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b05c7-9df6-43d7-a551-20719e88f6f9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.144445 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefa56f170cd45f1819cb356481c5e67, user_id=4e8eda99fafd4478a2589bbe6e280225, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.152602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.152773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.153351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.153697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.153986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.155362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.158541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.177501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 793/1626] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:32 2022] PUT /identity/v3/projects/aefa56f170cd45f1819cb356481c5e67/users/4e8eda99fafd4478a2589bbe6e280225/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:33.179269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.201436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 834/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:33.201436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.216817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869c1ce-d4ce-440c-859d-0de6108ffdd4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.311743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:33.333728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.334407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.334698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.334980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.341674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a3e68-6df3-40e7-9bac-d62fe7a166aa admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.349057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.350072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.350578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.351046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.352667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.356024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faad07-da75-4dd5-ad3b-543f99d761db admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.377419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:33.390933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 794/1628] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:33 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:33.392301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ee10-5031-4409-a428-fa9736136934 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.392658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ee10-5031-4409-a428-fa9736136934 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.392863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ee10-5031-4409-a428-fa9736136934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.431913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.433604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.464995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 835/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:33.465873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.484853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cab47-69a5-48d2-b6f9-68034153f06f service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.502766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.503696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.503983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.504614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6680ee10-5031-4409-a428-fa9736136934 None None] MFA Rules not processed for user `4e8eda99fafd4478a2589bbe6e280225`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:33.505066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] PATH_INFO: `/v3/projects/033d74801c2b4491b6a5282da10aef97/users/39b04ad5419a4a1988644499d25ef3c9/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.508272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6680ee10-5031-4409-a428-fa9736136934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:33.549808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] RBAC: Authorizing `identity:create_grant(project_id=033d74801c2b4491b6a5282da10aef97, user_id=39b04ad5419a4a1988644499d25ef3c9, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.559191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.605473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 836/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:33 2022] PUT /identity/v3/projects/033d74801c2b4491b6a5282da10aef97/users/39b04ad5419a4a1988644499d25ef3c9/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:33.606484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.755412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35202-e08a-42b9-b87c-01d93feb092e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.768312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.769164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.769525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.770030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.771036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.774925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.803142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 837/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:33.804276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.809933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 795/1632] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:33.811270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680ee10-5031-4409-a428-fa9736136934 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.836289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a636a-6251-4754-84df-4adc0798f9f5 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.842392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680ee10-5031-4409-a428-fa9736136934 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.849137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.850517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.850958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.851254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.851632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] PATH_INFO: `/v3/projects/ca87b9c2c90e4e258a0013494099be28/users/a3f463e42065431a84c14f805b4a9069/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.852194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.852550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.852929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.854114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.856698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.874727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca87b9c2c90e4e258a0013494099be28, user_id=a3f463e42065431a84c14f805b4a9069, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.877713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 838/1633] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:33.878357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.878708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.895542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 796/1634] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:33 2022] PUT /identity/v3/projects/ca87b9c2c90e4e258a0013494099be28/users/a3f463e42065431a84c14f805b4a9069/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:33.896930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:33.974335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903540-fef0-4e03-a866-df74e480004c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:33.980896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:33.981895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:33.982252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:33.982621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] PATH_INFO: `/v3/projects/033d74801c2b4491b6a5282da10aef97/users/39b04ad5419a4a1988644499d25ef3c9/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:33.989354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=033d74801c2b4491b6a5282da10aef97, user_id=39b04ad5419a4a1988644499d25ef3c9, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:33.994045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:33.999663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28549f-2d2f-4425-80be-55d15c6c39d2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:34.020679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 797/1635] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:33 2022] PUT /identity/v3/projects/033d74801c2b4491b6a5282da10aef97/users/39b04ad5419a4a1988644499d25ef3c9/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:34.023588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:34.095733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:34.129534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:34.130220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.130505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.132371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.143749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:34.162068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22663-781d-4f74-9fe3-cba3d51498ec admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:34.176968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:34.179358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.179685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.179973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.183722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:34.185961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c324e-858e-444d-a80c-41f9890b23e1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:34.218871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 798/1636] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:34.225833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a21a2-3bfc-48c5-a81e-588ad3458d2c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.226125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a21a2-3bfc-48c5-a81e-588ad3458d2c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.226406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a21a2-3bfc-48c5-a81e-588ad3458d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.293923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8f5a21a2-3bfc-48c5-a81e-588ad3458d2c None None] MFA Rules not processed for user `39b04ad5419a4a1988644499d25ef3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:34.299976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8f5a21a2-3bfc-48c5-a81e-588ad3458d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:34.313352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:34.316885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:34.347410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 839/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:34.348210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:34.374680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41a518-d772-4dde-8048-cc0bf8f0d1f2 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:34.388949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:34.391169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.391488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.391774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] PATH_INFO: `/v3/projects/ca87b9c2c90e4e258a0013494099be28/users/a3f463e42065431a84c14f805b4a9069/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.399071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca87b9c2c90e4e258a0013494099be28, user_id=a3f463e42065431a84c14f805b4a9069, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:34.410171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbee27-7197-46cd-972b-1551d47d108c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:34.433833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 840/1638] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:34 2022] PUT /identity/v3/projects/ca87b9c2c90e4e258a0013494099be28/users/a3f463e42065431a84c14f805b4a9069/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:34.444395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eee05-6a57-4dee-869d-d034135028f1 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.444745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eee05-6a57-4dee-869d-d034135028f1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.445092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eee05-6a57-4dee-869d-d034135028f1 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.446972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 841/1639] 10.222.0.23 () {54 vars in 912 bytes} [Wed Jul 20 14:48:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:34.448331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.448628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.448974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.503912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 799/1640] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:34.505356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.505943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.506345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.548684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] MFA Rules not processed for user `a3f463e42065431a84c14f805b4a9069`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:34.550117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:34.551197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:34.552629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:34.725371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 800/1641] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:34.734805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:34.743220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 842/1642] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:34.807222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:34.872242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:34.901673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c108a-dc93-4b60-8b2e-53796511c541 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:34.905756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:34.906453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.908490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.908793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.939361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01433df5-c339-4a98-9407-edf7ac91103a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:34.951776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:34.953007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:34.953503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:34.953978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:34.978123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:34.981400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:35.015889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:35.017680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:35.018385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 843/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:35.046503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 801/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:35.150081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:35.160790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a105-8aed-4382-b48c-c079efa9c632 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:35.175254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:35.176958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:35.176958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:35.176958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:35.219391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:35.365293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:35.366862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d791b-feec-4e32-b4d6-c530d4113f6f service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:35.403788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 844/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:48:36.429204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:36.451541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb9e00-8c32-4caf-b9f6-d319e81fe1cd service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:36.469540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:36.475971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:36.480644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:36.484084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:36.722178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:36.736532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc916300-6d37-423c-b1e4-7b83d42166f3 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:36.758129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 802/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:36 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:37.100160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce461d2-eed4-4d9d-b10f-6a1f3e6bb4cd None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.100657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce461d2-eed4-4d9d-b10f-6a1f3e6bb4cd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.100784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce461d2-eed4-4d9d-b10f-6a1f3e6bb4cd None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.103390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 845/1647] 10.222.0.23 () {54 vars in 962 bytes} [Wed Jul 20 14:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:37.162630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1914-1801-4a1e-8cee-a71b4a8b5417 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.162630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1914-1801-4a1e-8cee-a71b4a8b5417 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.162630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1914-1801-4a1e-8cee-a71b4a8b5417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.215680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dd8a1914-1801-4a1e-8cee-a71b4a8b5417 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:37.222829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dd8a1914-1801-4a1e-8cee-a71b4a8b5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:37.258442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 803/1648] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Jul 20 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:37.265931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb50c5-9237-4015-bc13-ae66dd55c116 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.266557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb50c5-9237-4015-bc13-ae66dd55c116 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.266973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb50c5-9237-4015-bc13-ae66dd55c116 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.269028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 846/1649] 10.222.0.23 () {54 vars in 912 bytes} [Wed Jul 20 14:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:37.275858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.276355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.277347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.289055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb50c5-9237-4015-bc13-ae66dd55c116 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:37.326682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:37.328249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:37.340633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 804/1650] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:37.357574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:37.377268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb1394-137e-4e7a-b610-dca65470777c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:37.387657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:37.390267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.390561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.390847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.421034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:37.425827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c974c-195a-457d-a554-6b3ba94b8177 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:37.458355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb50c5-9237-4015-bc13-ae66dd55c116 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:37.468943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:37.470109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.470553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.470868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] PATH_INFO: `/v3/users/5e3cd85d98764256ac7988b738874634` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.475174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3cd85d98764256ac7988b738874634)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:37.476295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 805/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:37.479849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:37.606273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3cd85d98764256ac7988b738874634'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:37.625350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3cd85d98764256ac7988b738874634'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:37.667371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3cd85d98764256ac7988b738874634'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:37.684336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3cd85d98764256ac7988b738874634'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:37.686105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3cd85d98764256ac7988b738874634'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:37.713556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 847/1652] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:37 2022] DELETE /identity/v3/users/5e3cd85d98764256ac7988b738874634 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:37.719212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:37.719532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:37.719822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:37.756343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:37.757583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:37.961468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:37.964017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:37.976616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 806/1653] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:38.053252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:38.079631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:38.081728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:38.101928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:38.137851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddcf73-5064-4683-8f45-15f17fb60516 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:38.160243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:38.162214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:38.163137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:38.167144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:38.176435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:38.298021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edea71-c4e0-4249-8db2-e992c251ccb0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:38.307627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:38.308309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:38.308590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:38.308869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:38.320773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:38.323216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:38.355236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 807/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:48:38.390321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:38.391770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:38.410534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 848/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:48:39.701409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:39.703572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:39.739012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae48a9-c44d-4b0f-b6a4-58279a396f60 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:39.762112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:39.763718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:39.766292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:39.766550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] PATH_INFO: `/v3/projects/26f65043912b45ecb11495dfd8e85e0d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:39.772191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f65043912b45ecb11495dfd8e85e0d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:39.774268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:39.944729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f65043912b45ecb11495dfd8e85e0d', 'request_id': 'req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:39.965881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f65043912b45ecb11495dfd8e85e0d', 'request_id': 'req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:39.978272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f65043912b45ecb11495dfd8e85e0d', 'request_id': 'req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.028546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] The token cache is being invalidate because project 26f65043912b45ecb11495dfd8e85e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:40.028863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.030432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.041525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 808/1656] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:39 2022] DELETE /identity/v3/projects/26f65043912b45ecb11495dfd8e85e0d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:40.042368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:40.060890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e08f6f-b0cb-426b-a073-faa3c1d2f3bf service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:40.376046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:40.376951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:40.377225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:40.377727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] PATH_INFO: `/v3/users/4e8eda99fafd4478a2589bbe6e280225` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:40.382988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8eda99fafd4478a2589bbe6e280225)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:40.391363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:40.566903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8eda99fafd4478a2589bbe6e280225'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.602283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8eda99fafd4478a2589bbe6e280225'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.647601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8eda99fafd4478a2589bbe6e280225'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.658142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8eda99fafd4478a2589bbe6e280225'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.659614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5e3f64bb-c2df-48be-871a-1a091bb2b00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8eda99fafd4478a2589bbe6e280225'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:40.668802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 849/1657] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:40 2022] DELETE /identity/v3/users/4e8eda99fafd4478a2589bbe6e280225 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:42.033433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:42.035030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:42.067313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4c65-4083-47ba-bb5e-90dfc78e353e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:42.349318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:42.350589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:42.351188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:42.352078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] PATH_INFO: `/v3/projects/aefa56f170cd45f1819cb356481c5e67` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:42.357783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefa56f170cd45f1819cb356481c5e67)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:42.368736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:42.498897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:42.537326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefa56f170cd45f1819cb356481c5e67', 'request_id': 'req-010d4585-6465-4b8f-864a-7b4e78cdad72'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:42.560609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefa56f170cd45f1819cb356481c5e67', 'request_id': 'req-010d4585-6465-4b8f-864a-7b4e78cdad72'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:42.584336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefa56f170cd45f1819cb356481c5e67', 'request_id': 'req-010d4585-6465-4b8f-864a-7b4e78cdad72'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:42.620512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] The token cache is being invalidate because project aefa56f170cd45f1819cb356481c5e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:42.620512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:42.625079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-010d4585-6465-4b8f-864a-7b4e78cdad72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:42.627598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 809/1658] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:42 2022] DELETE /identity/v3/projects/aefa56f170cd45f1819cb356481c5e67 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:42.632189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:42.632686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:42.633078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:42.653740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:42.729312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:42.736662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.018677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 850/1659] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:43.027231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.027664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.028039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.062435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:43.064046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.101608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fc00d-c5e6-4b87-be2d-2178b1bf4ee4 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:43.108664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:43.116711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.122145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:43.123665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.124107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.124810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] PATH_INFO: `/v3/users/f8152a5e47804a159b6271a075ef10d7` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.130417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8152a5e47804a159b6271a075ef10d7)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:43.139933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:43.155190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 810/1660] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:43.159935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:43.173512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.211912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fc6e-52bf-4764-8639-0cf6880f2413 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:43.232654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:43.233775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.234196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.234589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] PATH_INFO: `/v3/users/485531dc25a54d6ea00e28f93030b5a8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.239036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=485531dc25a54d6ea00e28f93030b5a8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:43.242541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: WARNING py.warnings [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:43.242541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: warnings.warn(msg) Jul 20 14:48:43.242541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: Jul 20 14:48:43.244293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:43.287923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8152a5e47804a159b6271a075ef10d7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.304719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8152a5e47804a159b6271a075ef10d7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.331976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8152a5e47804a159b6271a075ef10d7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.349451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8152a5e47804a159b6271a075ef10d7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.351511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8152a5e47804a159b6271a075ef10d7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.371685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 851/1661] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:43 2022] DELETE /identity/v3/users/f8152a5e47804a159b6271a075ef10d7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:43.373131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:43.378455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.471742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485531dc25a54d6ea00e28f93030b5a8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.491081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485531dc25a54d6ea00e28f93030b5a8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.565790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485531dc25a54d6ea00e28f93030b5a8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.566986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485531dc25a54d6ea00e28f93030b5a8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.629504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2ec10877-52ff-46b6-9eea-7c742373d0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485531dc25a54d6ea00e28f93030b5a8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:43.639829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 811/1662] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:43 2022] DELETE /identity/v3/users/485531dc25a54d6ea00e28f93030b5a8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:43.642890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad114d-4008-4dd6-926d-6c1495cd0018 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.643369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad114d-4008-4dd6-926d-6c1495cd0018 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.643862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad114d-4008-4dd6-926d-6c1495cd0018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.652831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772f62-77d6-4bef-99b5-b38bd3a03c84 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:43.691837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-80ad114d-4008-4dd6-926d-6c1495cd0018 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:43.693424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-80ad114d-4008-4dd6-926d-6c1495cd0018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.723545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:43.809835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:43.810535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.810810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.811249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.811950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:43.812258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:43.818095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:43.855542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 812/1663] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:43.861347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.861601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 852/1664] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:43.865394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.866026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.868911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:43.870838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.914605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa72d2-7e03-47c2-834d-b424343b1465 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:43.928392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:43.929096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:43.929373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:43.929659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:43.931054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:43.931333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:43.934132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:43.935760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.955678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 813/1665] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:43.956998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:43.967096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:43.992325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 853/1666] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:43 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:43.993751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.027036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:44.167991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f626c1-a2ab-45a3-b650-5c666985f21d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.210442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecdb11-f4b0-42de-b905-1cc79f0efa01 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.226684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.227527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.227867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.228211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.229039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.231321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.295409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 854/1667] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:43 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:44.296080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.299201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.301215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.302723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.303530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.329421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06846c-077a-421d-8263-d5ae2aa16162 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.338359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.341045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.350766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.351139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.351432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.351780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.360408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 814/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:44.361861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.382543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5c66-7ffd-4ab8-91fa-bed5090d0bae service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.385359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.386987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.389743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.392139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.392569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.393360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.395404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.400596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.414634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 855/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:44.436919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 815/1670] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:44.437209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.455570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0506b7-282d-4bef-9c56-1e71eb096857 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.464278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.465244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.465532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.465815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.466572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.468264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683563a-f521-405d-affa-0e4271ba009e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.501595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 856/1671] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:48:44.502847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.525198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bdc8-dc70-4b45-84e3-26db365f8ea6 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.531318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.532466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.532827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.533216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] PATH_INFO: `/v3/projects/e203593d74994231b57f77d78cb3399e/users/4c8a0fa80f774f45a0af97c5909934e6/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.572836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e203593d74994231b57f77d78cb3399e, user_id=4c8a0fa80f774f45a0af97c5909934e6, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.576442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:44.596939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 816/1672] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:44 2022] PUT /identity/v3/projects/e203593d74994231b57f77d78cb3399e/users/4c8a0fa80f774f45a0af97c5909934e6/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:44.615010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.615010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.615010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.677928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] MFA Rules not processed for user `4c8a0fa80f774f45a0af97c5909934e6`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:44.679285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:44.773681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:44.807485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 857/1673] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:44.812035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:44.924585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458067c0-2479-4617-a267-dae62947e182 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:44.941839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:44.943303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:44.943812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:44.945824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:44.947520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:44.949924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.003185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 817/1674] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:44 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:45.008739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:45.029705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c0abe-1d14-4e51-84ef-eddab2062e53 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:45.239015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:45.240388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.241150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.241692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.243708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:45.248921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.350798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:45.363811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 858/1675] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:45 2022] POST /identity/v3/users => generated 303 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:45.389350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224fc29-a382-4a9f-b628-6f1223369796 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:45.421998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:45.427618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.429393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.432744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.436833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:45.443725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac172-a1fd-4358-bc7f-9614f2d033b2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.517678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 818/1676] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:45.524761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:45.555404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e05aa-f93d-4da8-b6e3-c9d3c72465b8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:45.565859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d3eb-31f5-4b8f-868c-505799f6c687 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.566268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d3eb-31f5-4b8f-868c-505799f6c687 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.566770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d3eb-31f5-4b8f-868c-505799f6c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.570694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:45.571825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.572099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.572381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] PATH_INFO: `/v3/projects/198b8366e28f4370866ab069523b201d/users/3bd193614d7a465b80108c0dab67abd8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.615387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b8366e28f4370866ab069523b201d, user_id=3bd193614d7a465b80108c0dab67abd8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:45.624723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.657020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 859/1677] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:45 2022] PUT /identity/v3/projects/198b8366e28f4370866ab069523b201d/users/3bd193614d7a465b80108c0dab67abd8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:45.658598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:45.704924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5bd5d3eb-31f5-4b8f-868c-505799f6c687 None None] MFA Rules not processed for user `b917fb517461496885f5c5dfb6a0b207`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:45.706691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5bd5d3eb-31f5-4b8f-868c-505799f6c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:45.736432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:45.811356 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35d83-672a-4b21-844c-d8418af5109a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:45.825969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:45.827168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.827603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.828091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.828955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:45.832753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.849074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 860/1678] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:45.853696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:45.870726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099f4a2-644f-42a8-8485-e35f43e2d152 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:45.886263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:45.888387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.889596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.890456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] PATH_INFO: `/v3/projects/198b8366e28f4370866ab069523b201d/users/3bd193614d7a465b80108c0dab67abd8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.895585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b8366e28f4370866ab069523b201d, user_id=3bd193614d7a465b80108c0dab67abd8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:45.900678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 819/1679] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:45.902926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8de63a-b5da-440a-97a9-f06415d86a9e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:45.911382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.911800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.912182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.949542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 861/1680] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:45 2022] PUT /identity/v3/projects/198b8366e28f4370866ab069523b201d/users/3bd193614d7a465b80108c0dab67abd8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:45.951390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:45.952661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:45.952661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:45.962385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] MFA Rules not processed for user `b917fb517461496885f5c5dfb6a0b207`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:45.964063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:45.987486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] MFA Rules not processed for user `3bd193614d7a465b80108c0dab67abd8`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:45.988896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:46.027932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:46.089465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 862/1681] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:46.102440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:46.105478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:46.116713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 820/1682] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:46.133368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:46.137475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:46.256179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306eafb-b8ba-4d88-81d2-6524b71e96a8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:46.261959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:46.262666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:46.263169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:46.263534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:46.281677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:46.283163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:46.306857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 863/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:46.336667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e4a8d-1ee4-4315-94d3-4896567b5802 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:46.346125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:46.347235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:46.347750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:46.348221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:46.361717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:46.364560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a55a3b-a333-4803-835b-7421cf586046 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:46.382293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 821/1684] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:48:46.418114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:46.419629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:46.439025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d141427-d3a2-43ac-878b-fd046808a7d7 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:46.451377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:46.453005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:46.453304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:46.453614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:46.580630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:46.597995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9612b-ee8c-4caa-975d-06774255c385 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:46.614122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 864/1685] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:47.038978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.039496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.040507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.042744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 822/1686] 10.222.0.23 () {54 vars in 912 bytes} [Wed Jul 20 14:48:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:47.050703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.051336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.051718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.062464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:47.066166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.264627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:47.270892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.298305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:47.438658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c43a3-617c-4e99-9c8a-43374bfd3120 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:47.464536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:47.466682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:47.468808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.470599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.471971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] PATH_INFO: `/v3/projects/4646536c1ac1402eada52ae90ca3d1e8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.476883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4646536c1ac1402eada52ae90ca3d1e8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:47.483313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:47.483610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 865/1687] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:47.484569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:47.489686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.540666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da74d4-cb48-4028-aa1e-2e7dafa5c83e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:47.566225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:47.567128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.567410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.567798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] PATH_INFO: `/v3/projects/11ff216a65e8488baf25c661b8e609ed` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.574780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ff216a65e8488baf25c661b8e609ed)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:47.577189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: WARNING py.warnings [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 14:48:47.577189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: warnings.warn(msg) Jul 20 14:48:47.577189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: Jul 20 14:48:47.577561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:47.618231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4646536c1ac1402eada52ae90ca3d1e8', 'request_id': 'req-a857f7db-15cb-44ad-893d-1927d4c7aadc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.637192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4646536c1ac1402eada52ae90ca3d1e8', 'request_id': 'req-a857f7db-15cb-44ad-893d-1927d4c7aadc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.649916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4646536c1ac1402eada52ae90ca3d1e8', 'request_id': 'req-a857f7db-15cb-44ad-893d-1927d4c7aadc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.675615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] The token cache is being invalidate because project 4646536c1ac1402eada52ae90ca3d1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:47.675919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.677397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.682962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 823/1688] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:47 2022] DELETE /identity/v3/projects/4646536c1ac1402eada52ae90ca3d1e8 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:47.682962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:47.684054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.698111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ff216a65e8488baf25c661b8e609ed', 'request_id': 'req-0b7ea3df-c858-42e4-9998-f50016e3196f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.720204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ff216a65e8488baf25c661b8e609ed', 'request_id': 'req-0b7ea3df-c858-42e4-9998-f50016e3196f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.737082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ff216a65e8488baf25c661b8e609ed', 'request_id': 'req-0b7ea3df-c858-42e4-9998-f50016e3196f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.802635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] The token cache is being invalidate because project 11ff216a65e8488baf25c661b8e609ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:47.803584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.805399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:47.809572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 866/1689] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:47 2022] DELETE /identity/v3/projects/11ff216a65e8488baf25c661b8e609ed => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:47.817990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:47.827080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.856588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f7db-15cb-44ad-893d-1927d4c7aadc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:47.970830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:47.971945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.972062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.972259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.974516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:47.981761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ea3df-c858-42e4-9998-f50016e3196f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:47.985398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:47.986872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c0ed5-9552-409f-b172-c4ff014ee956 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:47.990501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:47.992413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:47.992838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:47.993816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] PATH_INFO: `/v3/users/a3f463e42065431a84c14f805b4a9069` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:47.997228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f463e42065431a84c14f805b4a9069)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.001299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.003691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 824/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:48.005166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fa3b-bc90-4e8f-9ac9-01cb30cc5a11 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.005457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fa3b-bc90-4e8f-9ac9-01cb30cc5a11 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.005737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fa3b-bc90-4e8f-9ac9-01cb30cc5a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.052214 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2965fa3b-bc90-4e8f-9ac9-01cb30cc5a11 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:48.054489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2965fa3b-bc90-4e8f-9ac9-01cb30cc5a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.075506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 825/1691] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:48.083286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.083683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.083971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.114097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f463e42065431a84c14f805b4a9069'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:48.119891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:48.121140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.131012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f463e42065431a84c14f805b4a9069'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:48.150579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 826/1692] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:48.152027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.173225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f463e42065431a84c14f805b4a9069'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:48.173954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05f65-ef7f-4aba-9f25-d3ffd3c3d489 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.186117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.186811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.187097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.187415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.188152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:48.188466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.190142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.207323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f463e42065431a84c14f805b4a9069'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:48.210480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e10a77a-26d7-4351-975e-eab5d3faa2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f463e42065431a84c14f805b4a9069'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:48.226420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 827/1693] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:48:48.228537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.232036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 867/1694] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:47 2022] DELETE /identity/v3/users/a3f463e42065431a84c14f805b4a9069 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:48.249213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.251715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefcaae-bb2d-4e01-aff0-8196cf6df338 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.252249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefcaae-bb2d-4e01-aff0-8196cf6df338 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.252604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefcaae-bb2d-4e01-aff0-8196cf6df338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.257699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:48.263567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:48.272581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979946-c3c6-40d8-a68f-47f577cb4525 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.299700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5cefcaae-bb2d-4e01-aff0-8196cf6df338 None None] MFA Rules not processed for user `9c158757829f47a2b698f86eb682430d`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:48.301982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5cefcaae-bb2d-4e01-aff0-8196cf6df338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.413593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.414285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.414569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.415477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.416772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.418707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.472923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 868/1695] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:48.487763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.488116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.488408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.496891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 828/1696] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/projects => generated 369 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:48.498242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.532476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] MFA Rules not processed for user `9c158757829f47a2b698f86eb682430d`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:48.534874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.655288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40530-86d1-48a0-93b5-f25e60dcd868 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.677761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.678514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.678764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.679121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.679892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.681917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.709100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 869/1697] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:48.719667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.722351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:48.755194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 829/1698] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:48 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:48:48.759814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.787165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8804-04bd-433e-909b-93c5c4b99add admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.811270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.812007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.812293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.812570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.813331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.820420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.869833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 830/1699] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:48:48.874677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.898437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e51bb-3977-46e3-92e3-d67f10877510 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.920932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.921634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.921928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.922210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:48.922968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:48.924665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:48.948401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 831/1700] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:48.952848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:48.975748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb508ce-9f8e-43e5-92fc-829dfe7f47cf admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:48.992374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:48.995270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:48.995755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:48.998282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] PATH_INFO: `/v3/projects/6d14e50ab81248ac92472579bd52891f/users/181765b61d3b410d97e9e841f3ee1087/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:49.006616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fd7fa-fe3c-4844-9af7-28de252bc777 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:49.027275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:49.028290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:49.052942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:49.055315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:49.061289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d14e50ab81248ac92472579bd52891f, user_id=181765b61d3b410d97e9e841f3ee1087, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:49.082983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:49.087904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:49.090726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da51c-0b89-47cc-a2b8-bee10653416e service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:49.133438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 870/1701] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:49.174973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 832/1702] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:48 2022] PUT /identity/v3/projects/6d14e50ab81248ac92472579bd52891f/users/181765b61d3b410d97e9e841f3ee1087/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:49.188602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:49.190597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:49.191292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:49.250655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] MFA Rules not processed for user `181765b61d3b410d97e9e841f3ee1087`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:49.252246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:49.272362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:49.471613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 871/1703] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:49.474484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:49.589212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:49.686197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b5a08-860a-4160-9912-9e60b1cda95c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:49.716330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:49.717036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:49.717323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:49.717602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:49.718485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:49.732470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:49.847893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 833/1704] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:49 2022] POST /identity/v3/projects => generated 367 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:48:49.854661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:49.876983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c6063-c701-4e3d-aba1-4492255c5471 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.090969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.091716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.092008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.092288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.093005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.095367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.163218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 872/1705] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:49 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:50.167322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:50.183963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9ac90-2a69-4bb4-9284-faa54af76614 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.190997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.191723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.192007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.192886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.194154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.197315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.222082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 834/1706] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:50.228890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:50.277921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed04ba0-5a77-4f42-b7fb-d5396dcad814 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.299121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.300129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.300353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.300635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] PATH_INFO: `/v3/projects/ae0a63dd8b674e09a142fa476c54533f/users/59ee0672cec142d99efb4847dc487ce8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.332577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0a63dd8b674e09a142fa476c54533f, user_id=59ee0672cec142d99efb4847dc487ce8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.336645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.381718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 873/1707] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:50 2022] PUT /identity/v3/projects/ae0a63dd8b674e09a142fa476c54533f/users/59ee0672cec142d99efb4847dc487ce8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:50.382326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:50.415010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff461e-abf9-40cd-83a3-4f0bc978d4d7 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.468471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:50.472579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:50.601353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.602065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.602395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.602680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.603438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.605108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6bc2-1242-48d6-9d6c-bcdbab9961c6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.661268 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 835/1708] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:50.669288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296589-d3e8-438a-9026-a90394655243 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.669932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296589-d3e8-438a-9026-a90394655243 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.671424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296589-d3e8-438a-9026-a90394655243 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.677642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 836/1709] 10.222.0.23 () {54 vars in 912 bytes} [Wed Jul 20 14:48:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:50.679661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296589-d3e8-438a-9026-a90394655243 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:50.704621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49752c9-24a1-4911-8fa0-8e5483dacc42 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.743846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.744433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.744726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.745007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] PATH_INFO: `/v3/projects/ca87b9c2c90e4e258a0013494099be28` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.748488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296589-d3e8-438a-9026-a90394655243 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:50.757517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca87b9c2c90e4e258a0013494099be28)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.773931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.777705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:50.778629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.778919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.779202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] PATH_INFO: `/v3/projects/ae0a63dd8b674e09a142fa476c54533f/users/59ee0672cec142d99efb4847dc487ce8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.796555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0a63dd8b674e09a142fa476c54533f, user_id=59ee0672cec142d99efb4847dc487ce8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:50.818107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f080fb8-4265-47df-9c83-1354ed28c5df admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:50.869066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 837/1710] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:50 2022] PUT /identity/v3/projects/ae0a63dd8b674e09a142fa476c54533f/users/59ee0672cec142d99efb4847dc487ce8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:50.873515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bbcc-ab19-4764-84e3-e3d308219f13 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:50.875108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bbcc-ab19-4764-84e3-e3d308219f13 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:50.875760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bbcc-ab19-4764-84e3-e3d308219f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:50.880426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:50.987947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-bb03bbcc-ab19-4764-84e3-e3d308219f13 None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:50.996971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bb03bbcc-ab19-4764-84e3-e3d308219f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.016548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca87b9c2c90e4e258a0013494099be28', 'request_id': 'req-fd000664-8d0a-4efd-b524-d2c7ed76811e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:51.044099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca87b9c2c90e4e258a0013494099be28', 'request_id': 'req-fd000664-8d0a-4efd-b524-d2c7ed76811e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:51.071050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca87b9c2c90e4e258a0013494099be28', 'request_id': 'req-fd000664-8d0a-4efd-b524-d2c7ed76811e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:51.162166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] The token cache is being invalidate because project ca87b9c2c90e4e258a0013494099be28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:51.162166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:51.165487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd000664-8d0a-4efd-b524-d2c7ed76811e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:51.189014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 874/1711] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:50 2022] DELETE /identity/v3/projects/ca87b9c2c90e4e258a0013494099be28 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:48:51.193787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49ed9-878b-4ead-8f21-cd05f3986476 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.198076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49ed9-878b-4ead-8f21-cd05f3986476 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.198686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49ed9-878b-4ead-8f21-cd05f3986476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.299621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 838/1712] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:51.303241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57838-55ee-49de-9895-2bdc49e9c4a9 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.303567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57838-55ee-49de-9895-2bdc49e9c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.303854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57838-55ee-49de-9895-2bdc49e9c4a9 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.307286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 839/1713] 10.222.0.23 () {54 vars in 961 bytes} [Wed Jul 20 14:48:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:48:51.308758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5049e8-197a-4355-b49c-3e0ed2c181e9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.310182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5049e8-197a-4355-b49c-3e0ed2c181e9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.310486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5049e8-197a-4355-b49c-3e0ed2c181e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.323407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-dda49ed9-878b-4ead-8f21-cd05f3986476 None None] MFA Rules not processed for user `59ee0672cec142d99efb4847dc487ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:51.329484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-dda49ed9-878b-4ead-8f21-cd05f3986476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.376021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ee5049e8-197a-4355-b49c-3e0ed2c181e9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:51.377297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ee5049e8-197a-4355-b49c-3e0ed2c181e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.492130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:51.626043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 840/1714] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:51.630833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.631127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.631410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.658884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 875/1715] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:51.661191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffff16-061c-4058-827b-0b7405eb1ac5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.661876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffff16-061c-4058-827b-0b7405eb1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.662400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffff16-061c-4058-827b-0b7405eb1ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.704073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:51.708752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.722978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c7ffff16-061c-4058-827b-0b7405eb1ac5 None None] MFA Rules not processed for user `b917fb517461496885f5c5dfb6a0b207`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:51.724998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c7ffff16-061c-4058-827b-0b7405eb1ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.917300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 876/1716] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:51.934521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 841/1717] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Jul 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:51.935112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:51.935951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:51.936421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:51.939103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:51.939693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:51.998506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:52.002111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:52.025943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 877/1718] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:52.027409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.036280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:52.070502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1b7e7-d071-4163-818b-9e8c88f961d1 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.082097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.082943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.083336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.083803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.096103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804ca9-1ec0-4d96-9e06-f1eafa4c425c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.106254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.107466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.107770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.108759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.111527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.113124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.138272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 878/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:52.139984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.184889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.185939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.196095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c6ea-ab99-4945-84ba-49127a780a21 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.232676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.237989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.239013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.240811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.242773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 842/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:52.242773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.251049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:52.288482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.299161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.318232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1afba-70c5-4895-88ae-7612b4c12ac6 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.325474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 879/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:52.353289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.353975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.354262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.354612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.355380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:48:52.355723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.357387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.393876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 843/1722] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:48:52.399748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.416380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:52.421225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618601e3-d136-4f4c-9785-f814ae2524ba service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.431410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.432549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.434721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.435203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.436372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.438702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541d216-806a-4054-bcf3-bfb6dc8a1638 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.531972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.539435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 880/1723] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:52 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:52.551142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0908-11eb-46e7-a14c-92ded053b158 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:52.634547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.634841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.635124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.727270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] MFA Rules not processed for user `5d0090359d7c46038b82bbb903abab93`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:52.732111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:52.797053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:52.800820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:52.800820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:52.801314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:52.801692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:52.813952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:52.882515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:52.929870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 844/1724] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:52 2022] POST /identity/v3/users => generated 290 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:52.936295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:52.961539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 881/1725] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:52.984255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405837fa-ec29-4391-9717-d3b968d62995 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:53.013016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:53.013717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.014000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.014276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.015852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:53.017502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:53.049590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 845/1726] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:53.053771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:53.072876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae7322-6760-4ea8-9bd5-4b640e5a22ac None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:53.094846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:53.096352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.096749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.097040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.097806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:53.104520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:53.136690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:53.153977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 882/1727] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:53.157145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:53.170534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0c02-fa5e-45d0-81e5-d9b4c6a39951 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:53.172237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:53.191490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:53.192438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.199101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.199647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] PATH_INFO: `/v3/projects/01365769ff2e40f081d9c2ea61bfd18c/users/2346672636624e3eb3e7af0a7f8b47ad/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.252440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540e16-28a0-4443-a9a6-efcd17e75a9f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:53.294397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:53.295325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.295701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.295933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] PATH_INFO: `/v3/users/4c8a0fa80f774f45a0af97c5909934e6` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.308751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8a0fa80f774f45a0af97c5909934e6)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:53.310394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01365769ff2e40f081d9c2ea61bfd18c, user_id=2346672636624e3eb3e7af0a7f8b47ad, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:53.316025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:53.317476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079691-31d9-4a79-bcc9-ef2a494d72fc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:53.354207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 846/1728] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:53 2022] PUT /identity/v3/projects/01365769ff2e40f081d9c2ea61bfd18c/users/2346672636624e3eb3e7af0a7f8b47ad/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:53.355754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76269-741b-41ec-a3d2-bfd8d90b50bf None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.356058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76269-741b-41ec-a3d2-bfd8d90b50bf None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.356333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76269-741b-41ec-a3d2-bfd8d90b50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.488647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5bf76269-741b-41ec-a3d2-bfd8d90b50bf None None] MFA Rules not processed for user `f435520f0ee748f1bac962c6b8051f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:53.499922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5bf76269-741b-41ec-a3d2-bfd8d90b50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:53.503078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8a0fa80f774f45a0af97c5909934e6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:53.553504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8a0fa80f774f45a0af97c5909934e6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:53.605546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8a0fa80f774f45a0af97c5909934e6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:53.656842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8a0fa80f774f45a0af97c5909934e6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:53.660983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c1e92c33-9663-4e7c-b9cd-5997ca5c0302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8a0fa80f774f45a0af97c5909934e6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:53.682509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 883/1729] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:53 2022] DELETE /identity/v3/users/4c8a0fa80f774f45a0af97c5909934e6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:53.684375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.684800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.684972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.771186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] MFA Rules not processed for user `2346672636624e3eb3e7af0a7f8b47ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:53.776736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:53.786346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 847/1730] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:53.790643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:53.790939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:53.793196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:53.862874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:53.867237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:53.868743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:54.038328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 884/1731] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:54.039544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:54.044724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:54.064794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 848/1732] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:54.066226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:54.084405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:54.134412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75502ec5-0d3b-4537-acc9-e23cd4142fc1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:54.150157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:54.151274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:54.151981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:54.162773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:54.163906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:54.166430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:54.211873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd874-e226-4c03-9003-b204b657bf52 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:54.233325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:54.235136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:54.241818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:54.242338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:54.243949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 849/1733] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:48:54 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:54.246063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:54.248868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:54.252597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:54.389964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:54.485106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c85a8-32cd-45e8-a494-889ccb1b34e8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:54.500794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:54.502649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:54.504069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:54.504847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:54.505079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:54.506955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:54.598871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 885/1734] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:54.600992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:54.623322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbde73d-3c23-4ba4-b675-d4dd5d48c95b service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:54.813691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:54.830467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:54.920098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 850/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:54.926129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:54.929775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:54.930530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:54.930815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:54.935213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:54.937391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:54.938279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:54.946228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:54.992063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:55.021066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 886/1736] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:48:54 2022] POST /identity/v3/users => generated 296 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:48:55.025840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:55.050215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b47826-c35d-4ebc-a03d-6bbb6af8cd2f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:55.072984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:55.075924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.076382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.076658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.077633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:55.080513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:55.102087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 887/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:55.104070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:55.119187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacede5-8b3d-415b-916f-3276fe42e01c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:55.132629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:55.134551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.134931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.135443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] PATH_INFO: `/v3/projects/aa5b010d0da04ceb866ad88a464ab49f/users/bd2845aa88824e8eafaedab73c870dde/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.211915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5b010d0da04ceb866ad88a464ab49f, user_id=bd2845aa88824e8eafaedab73c870dde, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:55.222624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:55.289412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 888/1738] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:55 2022] PUT /identity/v3/projects/aa5b010d0da04ceb866ad88a464ab49f/users/bd2845aa88824e8eafaedab73c870dde/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:55.294730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:55.367343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bfc8-1331-4e44-b8f7-a3d8027507cc service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:55.539907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:55.542405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.542870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.543839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.589494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca097f-4369-4c8d-9736-27334958a1ec admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:55.591186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:55.611432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:55.612182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.612460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.619620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.620441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:55.622267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:55.663566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 889/1739] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:48:55.669499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:55.705162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863312-7d88-40ba-b2e3-3692da345250 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:55.721067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:55.721989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.722883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.723174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] PATH_INFO: `/v3/projects/aa5b010d0da04ceb866ad88a464ab49f/users/bd2845aa88824e8eafaedab73c870dde/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.728921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5b010d0da04ceb866ad88a464ab49f, user_id=bd2845aa88824e8eafaedab73c870dde, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:55.731751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673b87f-aae1-4aa9-abc2-48b099906348 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:55.766058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 890/1740] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:48:55 2022] PUT /identity/v3/projects/aa5b010d0da04ceb866ad88a464ab49f/users/bd2845aa88824e8eafaedab73c870dde/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:55.777199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:55.777393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:55.777676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:55.857981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] MFA Rules not processed for user `bd2845aa88824e8eafaedab73c870dde`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:55.859559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:55.875383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:55.882878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:55.943345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 851/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1021 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:56.073671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:56.075712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:56.110701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22934-8d5d-4367-b2bc-1ec6a2ea1e96 service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:56.215786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 891/1742] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:56.244837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:56.246884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:56.347519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:56.348510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:56.348801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:56.349892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] PATH_INFO: `/v3/projects/e203593d74994231b57f77d78cb3399e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:56.358354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:56.359118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e203593d74994231b57f77d78cb3399e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:56.362532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:56.494247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b3016-9a27-496a-af69-4d0ef9c5e6b6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:56.514449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e203593d74994231b57f77d78cb3399e', 'request_id': 'req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:56.541110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e203593d74994231b57f77d78cb3399e', 'request_id': 'req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:56.564907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e203593d74994231b57f77d78cb3399e', 'request_id': 'req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:56.627334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] The token cache is being invalidate because project e203593d74994231b57f77d78cb3399e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:48:56.627748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:56.630651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:56.637462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 852/1743] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:48:56 2022] DELETE /identity/v3/projects/e203593d74994231b57f77d78cb3399e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:56.653513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:56.661582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:56.671929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:56.675259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:56.677009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:56.678055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:56.687224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:56.885254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:56.957832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:56.968312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:56.980711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7437ec-ad1d-4cf8-bb30-d9db94ae7369 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:57.006898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 892/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:48:57.008107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:57.010982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:57.012604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:57.014436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] PATH_INFO: `/v3/users/3bd193614d7a465b80108c0dab67abd8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:57.028149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd193614d7a465b80108c0dab67abd8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:57.034363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:57.231334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd193614d7a465b80108c0dab67abd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:57.253537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd193614d7a465b80108c0dab67abd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:57.314074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd193614d7a465b80108c0dab67abd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:57.321478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd193614d7a465b80108c0dab67abd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:57.361548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-0cf1a984-96b3-4d20-89ad-ffd39db311b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd193614d7a465b80108c0dab67abd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:57.411064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 853/1745] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:56 2022] DELETE /identity/v3/users/3bd193614d7a465b80108c0dab67abd8 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:57.939404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:57.941233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:57.980612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b14-08e5-4543-aba2-9ede4d78c660 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:58.046253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:58.047298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:58.048506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:58.232472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:58.237861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:58.237861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:58.237861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] PATH_INFO: `/v3/users/181765b61d3b410d97e9e841f3ee1087` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:58.244200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181765b61d3b410d97e9e841f3ee1087)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:58.261729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:58.436239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:58.438594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:58.448002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:58.520158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181765b61d3b410d97e9e841f3ee1087'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:58.549567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181765b61d3b410d97e9e841f3ee1087'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:58.593205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181765b61d3b410d97e9e841f3ee1087'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:58.632005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181765b61d3b410d97e9e841f3ee1087'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:58.638849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c6803d91-48db-4aa6-83b1-aa9304559bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181765b61d3b410d97e9e841f3ee1087'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:58.663330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 893/1746] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:57 2022] DELETE /identity/v3/users/181765b61d3b410d97e9e841f3ee1087 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:48:58.674932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:58.674932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:58.674932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:58.774700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 854/1747] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 731 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:48:58.775895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:58.777156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:58.959207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:58.961886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:59.053159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 894/1748] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:48:59.056009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:59.058485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:59.061715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:59.096115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc6f2-3cd4-4bfd-9a73-36b78f879275 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:59.109687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:59.110775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:59.113791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:59.114091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] PATH_INFO: `/v3/users/2346672636624e3eb3e7af0a7f8b47ad` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:59.116103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2346672636624e3eb3e7af0a7f8b47ad)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:59.124666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:59.190798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bed6-b16b-4aad-a539-34a4d07f5501 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:59.241472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2346672636624e3eb3e7af0a7f8b47ad'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:59.264041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2346672636624e3eb3e7af0a7f8b47ad'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:59.302085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2346672636624e3eb3e7af0a7f8b47ad'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:59.328386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2346672636624e3eb3e7af0a7f8b47ad'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:59.329497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2346672636624e3eb3e7af0a7f8b47ad'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:48:59.345503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:59.346375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:59.346771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:59.348349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:59.352867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:59.353127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 895/1749] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:48:59 2022] DELETE /identity/v3/users/2346672636624e3eb3e7af0a7f8b47ad => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:48:59.360710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:48:59.369483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:59.486362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:48:59.606299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:48:59.612080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cfec8-936d-45be-82b0-9c74781575c5 service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:48:59.640492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 855/1750] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:48:59.642509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:59.643958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:59.644254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:59.651536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6f58-6829-4197-80a7-d285fdb2b564 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:48:59.666483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:48:59.668831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:48:59.669151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:48:59.669399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:48:59.677886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:48:59.739377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:48:59.746947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:00.003368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:00.006601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:00.041795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 896/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:00.084813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:00.087826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:00.090289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:00.121262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a265-5976-4236-a217-8fb75ea6a6cf service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:00.140364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:00.141604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:00.142068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:00.142838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] PATH_INFO: `/v3/users/d610eeb047b643bdbf18ed716714df39` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:00.144626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d610eeb047b643bdbf18ed716714df39)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:00.150694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:00.153832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 856/1752] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:00.337498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:00.372515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf4cc-5648-4994-bd7a-1ba62db329c5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:00.391638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:00.393267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:00.394200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:00.395063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:00.462146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:00.469721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd610eeb047b643bdbf18ed716714df39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:00.481042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13724ef-c09f-482b-81d8-e8eefcf2a1ed service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:00.507197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd610eeb047b643bdbf18ed716714df39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:00.550713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 857/1753] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:00.605404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd610eeb047b643bdbf18ed716714df39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:00.656835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd610eeb047b643bdbf18ed716714df39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:00.660728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd610eeb047b643bdbf18ed716714df39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:00.712312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 897/1754] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:00 2022] DELETE /identity/v3/users/d610eeb047b643bdbf18ed716714df39 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:00.719273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dab5-d799-45d5-9323-0c4be8788a91 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:00.721656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dab5-d799-45d5-9323-0c4be8788a91 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:00.722215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dab5-d799-45d5-9323-0c4be8788a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:00.828281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d374dab5-d799-45d5-9323-0c4be8788a91 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:00.836102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d374dab5-d799-45d5-9323-0c4be8788a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:01.087855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 858/1755] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:01.226401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:01.228811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:01.484038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:01.608476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-179f-498d-8550-06c00f95d744 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:01.629651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:01.630303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:01.630590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:01.630872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:01.662638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:01.673756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:01.718672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 898/1756] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:04.155572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:04.165346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:04.165346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:04.242983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:04.250828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:04.317555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 859/1757] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Jul 20 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:04.345893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:04.347482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:04.368278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876eaf-175b-45c3-939d-df00e1b5f9de service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:04.378637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:04.379574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:04.379853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:04.380364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:04.405551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:04.407381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:04.425995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 899/1758] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:04.638089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:04.638089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:04.639651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:04.641354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:04.682635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ce6-a1a3-41f3-9a5f-4596b4fdf44c service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:04.687976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f6cb-442a-4939-b290-d38e41b5fef8 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:04.696969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:04.697740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:04.698674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:04.699157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:04.699789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] PATH_INFO: `/v3/projects/198b8366e28f4370866ab069523b201d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:04.702319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198b8366e28f4370866ab069523b201d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:04.705682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:04.715831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:04.716031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:04.716321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] PATH_INFO: `/v3/projects/6d14e50ab81248ac92472579bd52891f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:04.722087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d14e50ab81248ac92472579bd52891f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:04.729397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:04.835699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198b8366e28f4370866ab069523b201d', 'request_id': 'req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.853410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198b8366e28f4370866ab069523b201d', 'request_id': 'req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.897236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198b8366e28f4370866ab069523b201d', 'request_id': 'req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.937133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] The token cache is being invalidate because project 198b8366e28f4370866ab069523b201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:04.939741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.940869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e8bf702-02bb-4a5c-9b1a-bb0a86ad0959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.944659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d14e50ab81248ac92472579bd52891f', 'request_id': 'req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:04.945496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 900/1759] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:04 2022] DELETE /identity/v3/projects/198b8366e28f4370866ab069523b201d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:04.955545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9674-d23c-43aa-88e3-0834b5853b68 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:04.955991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9674-d23c-43aa-88e3-0834b5853b68 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:04.956322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9674-d23c-43aa-88e3-0834b5853b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:04.975946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d14e50ab81248ac92472579bd52891f', 'request_id': 'req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.004448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-279e9674-d23c-43aa-88e3-0834b5853b68 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:05.005854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d14e50ab81248ac92472579bd52891f', 'request_id': 'req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.010616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-279e9674-d23c-43aa-88e3-0834b5853b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:05.049170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] The token cache is being invalidate because project 6d14e50ab81248ac92472579bd52891f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:05.049456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.050306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.056248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 860/1760] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:04 2022] DELETE /identity/v3/projects/6d14e50ab81248ac92472579bd52891f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:05.060165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:05.061783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:05.140239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 901/1761] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:05.146641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:05.147098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:05.147402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:05.204394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:05.207149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:05.246981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 902/1762] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:05.252920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:05.305469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9cee-8959-4590-882d-360f3cf45b61 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:05.328958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:05.329668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:05.330005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:05.330290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:05.331049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:05.331357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:05.333023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:05.392834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 903/1763] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:05.393514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fab4e-3dd7-47cb-a504-b2bad1ccb924 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:05.395696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:05.417551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739e80-6817-44fe-b7af-a163985013b8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:05.419961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:05.420891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:05.421175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:05.421973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] PATH_INFO: `/v3/users/59ee0672cec142d99efb4847dc487ce8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:05.425839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ee0672cec142d99efb4847dc487ce8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:05.429740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:05.432264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:05.433456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:05.434082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:05.435531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:05.436426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:05.439108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:05.440677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:05.512842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 904/1764] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:05 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:05.519903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:05.555044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ee0672cec142d99efb4847dc487ce8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.563647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:05.573486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ee0672cec142d99efb4847dc487ce8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.614499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ee0672cec142d99efb4847dc487ce8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.617035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ee0672cec142d99efb4847dc487ce8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.656436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ee0672cec142d99efb4847dc487ce8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:05.674775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 861/1765] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:05 2022] DELETE /identity/v3/users/59ee0672cec142d99efb4847dc487ce8 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:05.797123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe0bf-439c-4ac6-8775-de2af5b92097 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:05.961622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:05.962332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:05.962701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:05.962983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:05.963816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:05.974082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:06.032836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 905/1766] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:05 2022] POST /identity/v3/users => generated 295 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:06.040922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:06.043059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:06.068140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719a2e-b843-4f24-8f8b-3eb747f31fbf admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:06.082791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:06.084157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:06.096993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:06.096993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:06.099587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:06.113628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:06.172946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 862/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:06.173940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:06.205382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91699cb-28da-49ea-8983-ac8ed543de11 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:06.236380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:06.237177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:06.237581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:06.237963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:06.238921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:06.242892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c958bb3-9461-4336-8031-521227ef8733 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:06.296453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 906/1768] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:06.301029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:06.314383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082271b3-c9bd-4177-b036-9234196c0c82 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:06.341344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:06.342295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:06.342585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:06.342872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] PATH_INFO: `/v3/projects/46ebacae7cda40ebaba2ac78e14941c8/users/eec891b8a9ac4c9b89e53ea5894e08c7/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:06.400674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ebacae7cda40ebaba2ac78e14941c8, user_id=eec891b8a9ac4c9b89e53ea5894e08c7, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:06.406288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:06.449940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 863/1769] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:06 2022] PUT /identity/v3/projects/46ebacae7cda40ebaba2ac78e14941c8/users/eec891b8a9ac4c9b89e53ea5894e08c7/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:06.461657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:06.462305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:06.462305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:06.590385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] MFA Rules not processed for user `eec891b8a9ac4c9b89e53ea5894e08c7`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:06.593620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:06.848849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 907/1770] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:06.850184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:07.106779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c575-5dfa-49d3-8cf2-a5d872f6a3a5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:07.133702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:07.136126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:07.136739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:07.137201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:07.139309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:07.142536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:07.229710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 864/1771] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:06 2022] POST /identity/v3/projects => generated 389 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:07.234807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:07.273266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcd25c-85bc-4f3c-a7fb-bd25af685430 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:07.472292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:07.720718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:07.721653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:07.722861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:07.723314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:07.724840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:07.731260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:07.790338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 908/1772] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:07 2022] POST /identity/v3/users => generated 301 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:07.795655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:07.827821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c59c-c304-4584-91e6-05475946594f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:07.863180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:07.865976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:07.866385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:07.879627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:07.885901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:07.893372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:07.966401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 865/1773] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:07.971885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:07.982874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:07.997858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:08.023811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef1a41-3948-40fd-a00e-4699598ecf66 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:08.057792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:08.058020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740519e4-ff51-45d3-bac6-aba4ab4fa985 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:08.058742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.059009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.067561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] PATH_INFO: `/v3/projects/fb7112962a8640a9b2397bd5d1a24f18/users/83b2e7355eea4c8fac79487d63e6b880/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:08.089876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:08.093738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.094029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.094313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] PATH_INFO: `/v3/projects/01365769ff2e40f081d9c2ea61bfd18c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:08.099183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01365769ff2e40f081d9c2ea61bfd18c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:08.101288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:08.150450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7112962a8640a9b2397bd5d1a24f18, user_id=83b2e7355eea4c8fac79487d63e6b880, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:08.167291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:08.197313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:08.206905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 909/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:07 2022] PUT /identity/v3/projects/fb7112962a8640a9b2397bd5d1a24f18/users/83b2e7355eea4c8fac79487d63e6b880/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:08.212247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:08.295858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01365769ff2e40f081d9c2ea61bfd18c', 'request_id': 'req-1b019f7f-9c68-40b2-9212-da84292fcf16'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:08.310888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01365769ff2e40f081d9c2ea61bfd18c', 'request_id': 'req-1b019f7f-9c68-40b2-9212-da84292fcf16'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:08.342177 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01365769ff2e40f081d9c2ea61bfd18c', 'request_id': 'req-1b019f7f-9c68-40b2-9212-da84292fcf16'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:08.385805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] The token cache is being invalidate because project 01365769ff2e40f081d9c2ea61bfd18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:08.386868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:08.389409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:08.399604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 866/1775] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:07 2022] DELETE /identity/v3/projects/01365769ff2e40f081d9c2ea61bfd18c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:08.400340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36424-a8e9-49ab-a201-cecb6ef9abcb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:08.404063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:08.406521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:08.631651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:08.637040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.638282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.638282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:08.641038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:08.650400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:08.716395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019f7f-9c68-40b2-9212-da84292fcf16 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:08.717913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 910/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:08.737529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:08.743508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:08.751730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:08.753222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.755952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.756541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] PATH_INFO: `/v3/users/bd2845aa88824e8eafaedab73c870dde` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:08.758738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2845aa88824e8eafaedab73c870dde)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:08.778905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:08.801634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9488-07f4-465c-af70-b0a2af8b445c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:08.832859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:08.835090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.835643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.836701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] PATH_INFO: `/v3/projects/fb7112962a8640a9b2397bd5d1a24f18/users/83b2e7355eea4c8fac79487d63e6b880/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:08.842022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7112962a8640a9b2397bd5d1a24f18, user_id=83b2e7355eea4c8fac79487d63e6b880, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:08.849996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda84ec-2bd4-4010-be37-1e3921cbbf73 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:08.880921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 911/1777] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:08 2022] PUT /identity/v3/projects/fb7112962a8640a9b2397bd5d1a24f18/users/83b2e7355eea4c8fac79487d63e6b880/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:08.898620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bca0e-dd67-47d5-8345-911e80e6cbc6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:08.901477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bca0e-dd67-47d5-8345-911e80e6cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:08.902378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bca0e-dd67-47d5-8345-911e80e6cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.023265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2845aa88824e8eafaedab73c870dde'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.056650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a02bca0e-dd67-47d5-8345-911e80e6cbc6 None None] MFA Rules not processed for user `83b2e7355eea4c8fac79487d63e6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:09.065030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a02bca0e-dd67-47d5-8345-911e80e6cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:09.066450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2845aa88824e8eafaedab73c870dde'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.098000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2845aa88824e8eafaedab73c870dde'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.099060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2845aa88824e8eafaedab73c870dde'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.101143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:09.122675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2845aa88824e8eafaedab73c870dde'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.147440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 867/1778] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:08 2022] DELETE /identity/v3/users/bd2845aa88824e8eafaedab73c870dde => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:09.267040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 912/1779] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:09.281660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:09.283724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:09.304190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:09.305204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:09.305496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.307246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 913/1780] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:49:09.333943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:09.390019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:09.394882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:09.449371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d979-3409-4929-9712-9f07ae588238 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:09.461291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:09.462002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:09.463165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:09.464689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.622454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:09.623978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a0334-03d8-4797-825c-a727fa06c812 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:09.627158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97f89a-c74d-44b4-9a03-d11763ee5e94 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:09.645457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:09.646351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:09.646651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:09.646922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] PATH_INFO: `/v3/projects/461587b203c4417b864f9d68481251d6` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.666354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461587b203c4417b864f9d68481251d6)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:09.672346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:09.677664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 868/1781] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:09.679241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:09.679559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:09.680410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.733703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:09.736031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:09.855856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461587b203c4417b864f9d68481251d6', 'request_id': 'req-789b3e7e-a626-467e-a54c-c7ca70e4f596'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.891178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461587b203c4417b864f9d68481251d6', 'request_id': 'req-789b3e7e-a626-467e-a54c-c7ca70e4f596'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.920158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461587b203c4417b864f9d68481251d6', 'request_id': 'req-789b3e7e-a626-467e-a54c-c7ca70e4f596'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.955079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] The token cache is being invalidate because project 461587b203c4417b864f9d68481251d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:09.955579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.960092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-789b3e7e-a626-467e-a54c-c7ca70e4f596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:09.967080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 914/1782] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:09 2022] DELETE /identity/v3/projects/461587b203c4417b864f9d68481251d6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:09.968639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:09.968933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:09.969213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:09.993510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 869/1783] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:09.997571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:10.010459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:10.025174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] MFA Rules not processed for user `f435520f0ee748f1bac962c6b8051f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:10.026530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:10.041709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c3daf-fa32-4ed5-bdfe-9e8b5e6fa953 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:10.114632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:10.217809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 915/1784] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:10.220161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:10.233805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:10.241769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:10.245659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:10.245961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:10.248018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] PATH_INFO: `/v3/users/39b04ad5419a4a1988644499d25ef3c9` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:10.255190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b04ad5419a4a1988644499d25ef3c9)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:10.265303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:10.304604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:10.310169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff01a6-e00f-4c85-a94e-5d99bce3f3cc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:10.349540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:10.351002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:10.351280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:10.352829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] PATH_INFO: `/v3/users/eec891b8a9ac4c9b89e53ea5894e08c7` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:10.358368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec891b8a9ac4c9b89e53ea5894e08c7)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:10.372745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:10.453317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b04ad5419a4a1988644499d25ef3c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.479190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b04ad5419a4a1988644499d25ef3c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.553238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b04ad5419a4a1988644499d25ef3c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.556475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b04ad5419a4a1988644499d25ef3c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.574808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec891b8a9ac4c9b89e53ea5894e08c7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.585766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b04ad5419a4a1988644499d25ef3c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.605621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec891b8a9ac4c9b89e53ea5894e08c7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.624759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 870/1785] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:09 2022] DELETE /identity/v3/users/39b04ad5419a4a1988644499d25ef3c9 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:10.625907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:10.636633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:10.669575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec891b8a9ac4c9b89e53ea5894e08c7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.709556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec891b8a9ac4c9b89e53ea5894e08c7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.713044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec891b8a9ac4c9b89e53ea5894e08c7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:10.745592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 916/1786] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:10 2022] DELETE /identity/v3/users/eec891b8a9ac4c9b89e53ea5894e08c7 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:10.751886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:10.759268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:10.961208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a54aa-824a-42dc-bc9e-485aa8d61e40 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:11.012902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed1f2-05ee-445a-9fb8-8fdacea8163a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:11.024858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:11.026211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.026711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.027959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] PATH_INFO: `/v3/projects/ae0a63dd8b674e09a142fa476c54533f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.032879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0a63dd8b674e09a142fa476c54533f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:11.037157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:11.162094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374192af-b779-4b05-964c-606730c08162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:11.165326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374192af-b779-4b05-964c-606730c08162 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.167879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374192af-b779-4b05-964c-606730c08162 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.168282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374192af-b779-4b05-964c-606730c08162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.175139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-374192af-b779-4b05-964c-606730c08162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.234903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0a63dd8b674e09a142fa476c54533f', 'request_id': 'req-a3d654e5-af4b-40ef-a365-bcefa4401f65'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:11.263160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374192af-b779-4b05-964c-606730c08162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:11.266211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374192af-b779-4b05-964c-606730c08162 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:11.286590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0a63dd8b674e09a142fa476c54533f', 'request_id': 'req-a3d654e5-af4b-40ef-a365-bcefa4401f65'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:11.290443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:11.307969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0a63dd8b674e09a142fa476c54533f', 'request_id': 'req-a3d654e5-af4b-40ef-a365-bcefa4401f65'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:11.325929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 871/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:11.335752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.336772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.337220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.352698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] The token cache is being invalidate because project ae0a63dd8b674e09a142fa476c54533f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:11.362314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:11.366736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a3d654e5-af4b-40ef-a365-bcefa4401f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:11.369908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 917/1788] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:10 2022] DELETE /identity/v3/projects/ae0a63dd8b674e09a142fa476c54533f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:11.395187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf65c-5fe0-481c-8f52-ff2f94f2498f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.395816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf65c-5fe0-481c-8f52-ff2f94f2498f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.396260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cf65c-5fe0-481c-8f52-ff2f94f2498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.425767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:11.442723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:11.454440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.465667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-613cf65c-5fe0-481c-8f52-ff2f94f2498f None None] MFA Rules not processed for user `5d0090359d7c46038b82bbb903abab93`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:11.466985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-613cf65c-5fe0-481c-8f52-ff2f94f2498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.660696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 918/1789] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:11.660696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a642c-3be0-41bd-876f-b01336c131a4 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.660696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a642c-3be0-41bd-876f-b01336c131a4 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.660696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a642c-3be0-41bd-876f-b01336c131a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.686598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e70a642c-3be0-41bd-876f-b01336c131a4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:11.688655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e70a642c-3be0-41bd-876f-b01336c131a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.710382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 919/1790] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:11.712826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.713120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.713677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.717810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 872/1791] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:11.748722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:11.753707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.779765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 920/1792] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:11.782854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:11.800298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffaf80-40dd-4a9c-bced-dc6667c10a24 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:11.823530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:11.825785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:11.832180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:11.833301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.833768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.834218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.835508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:11.840449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:11.842585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:11.890029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 873/1793] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:11.895871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:11.921197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ddf32-3b12-4d41-95ab-80c5ba1d6ae1 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:11.933892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:11.936258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:11.936808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:11.937274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:11.938495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:11.944557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.016461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 874/1794] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:11 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:12.022585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:12.035859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1a9d-0b1a-48a0-8e6d-1730f8f4ef82 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:12.191901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:12.192534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.192810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.193082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.208974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:12.209212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8926-f2a3-41d3-9153-b81c737b841e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:12.210362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.220768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:12.221482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.221812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.222104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.222824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:12.226829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.239614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 921/1795] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:12.291309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 875/1796] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:12 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:12.295590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:12.311799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314bad5-0058-4a94-8ac3-c43ece3b35c1 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:12.320206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:12.323669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.327247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.328330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.336705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:12.341920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.380551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 922/1797] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:12.381916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:12.409086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ade75-cb87-4b17-8d50-dd73c4199eda admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:12.418081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:12.418920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.419212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.419555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.420320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:12.421985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47261f94-ec00-4efa-a393-9a56986f2839 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.463552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 876/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:12.465762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:12.496947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be8ff-464a-4fbe-b42d-a1b8a0f89b19 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:12.537971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:12.547039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.548546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.549045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] PATH_INFO: `/v3/projects/7f86d1ea19914223b1790236c8fd1845/users/fa6b88899b484aba9208dc55593be286/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.601244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f86d1ea19914223b1790236c8fd1845, user_id=fa6b88899b484aba9208dc55593be286, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:12.613999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f5da-1598-4f14-a347-a6a1dc685617 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:12.688928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 923/1799] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:12 2022] PUT /identity/v3/projects/7f86d1ea19914223b1790236c8fd1845/users/fa6b88899b484aba9208dc55593be286/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:12.707586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:12.708702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:12.709598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:12.835877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] MFA Rules not processed for user `fa6b88899b484aba9208dc55593be286`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:12.838374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:13.074640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:13.076139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101b4c-a055-4663-80d9-01597543d902 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.076469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101b4c-a055-4663-80d9-01597543d902 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.076702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101b4c-a055-4663-80d9-01597543d902 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.078672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 924/1800] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:49:13.106434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.106805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.107127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.137494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 877/1801] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:13.143000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:13.150004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:13.182052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:13.183328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:13.315472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 925/1802] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:13.348875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aaccf-93a2-4643-990d-84ec60c7c8c8 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:13.355712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:13.356696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.357007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.357271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.358058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:13.361072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:13.421588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 878/1803] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:13 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:13.423068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:13.437797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15c12b-926b-48c3-8d12-72f92924801c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:13.527413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:13.528162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.528446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.528752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.530806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:13.533804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:13.560064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 926/1804] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:13 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:13.564246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:13.576612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121f63-8df5-4136-9fd2-376afe76c6a8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:13.587366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:13.588291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.588776 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.589279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.590820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:13.594898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:13.612599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 879/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:13.616326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:13.629783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effbe47-2491-4112-9a9f-14c796b47bae admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:13.636879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:13.640040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.640599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.641027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.643112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:13.645945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f65560-6a27-4c8d-bc5a-015598fb4479 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:13.664035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 927/1806] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:13.668788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:13.684276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebff451-c1c0-4f73-a8d3-ce8b66f5c829 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:13.691249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:13.692431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.693094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.693387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] PATH_INFO: `/v3/projects/4b61d497c51e4a2e927265a1e721b7cc/users/f2006674b9264bcf848952a1c9b07370/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.727977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b61d497c51e4a2e927265a1e721b7cc, user_id=f2006674b9264bcf848952a1c9b07370, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:13.733112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:13.758674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 880/1807] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:13 2022] PUT /identity/v3/projects/4b61d497c51e4a2e927265a1e721b7cc/users/f2006674b9264bcf848952a1c9b07370/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:13.769437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:13.770342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:13.770342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:13.806559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] MFA Rules not processed for user `f2006674b9264bcf848952a1c9b07370`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:13.808288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:13.920631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 928/1808] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:13.927130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.016274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.025610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:14.041545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8e59c-6ba9-464c-808b-36a04a9cfd8a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:14.052212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:14.053269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.053709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.054763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:14.056094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.058077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:14.065541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:14.075415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c16d88-3ee9-4cac-bcc8-90f3ceb7318c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:14.092299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:14.093338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.093784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.094071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] PATH_INFO: `/v3/projects/aa5b010d0da04ceb866ad88a464ab49f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.097040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5b010d0da04ceb866ad88a464ab49f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:14.099483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:14.153604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 881/1809] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:13 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:14.153604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.158036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:14.210236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:14.217760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5b010d0da04ceb866ad88a464ab49f', 'request_id': 'req-10bc9441-bd63-4eae-8d05-7194acbbe29b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.235336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5b010d0da04ceb866ad88a464ab49f', 'request_id': 'req-10bc9441-bd63-4eae-8d05-7194acbbe29b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.251058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5b010d0da04ceb866ad88a464ab49f', 'request_id': 'req-10bc9441-bd63-4eae-8d05-7194acbbe29b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.267925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] The token cache is being invalidate because project aa5b010d0da04ceb866ad88a464ab49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:14.268526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.269316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.276048 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 929/1810] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:14 2022] DELETE /identity/v3/projects/aa5b010d0da04ceb866ad88a464ab49f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:14.277014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.280621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:14.315252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c414a68-70c3-4ae5-87ff-2d9c5df2c2a1 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:14.396447 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:14.397462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.397784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.398233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] PATH_INFO: `/v3/projects/46ebacae7cda40ebaba2ac78e14941c8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.400224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ebacae7cda40ebaba2ac78e14941c8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:14.402962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:14.457223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc9441-bd63-4eae-8d05-7194acbbe29b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:14.486609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ebacae7cda40ebaba2ac78e14941c8', 'request_id': 'req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.511134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ebacae7cda40ebaba2ac78e14941c8', 'request_id': 'req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.523209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ebacae7cda40ebaba2ac78e14941c8', 'request_id': 'req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.567247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] The token cache is being invalidate because project 46ebacae7cda40ebaba2ac78e14941c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:14.567826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.573494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.575251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 882/1811] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:14 2022] DELETE /identity/v3/projects/46ebacae7cda40ebaba2ac78e14941c8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:14.579182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.582988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:14.608452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:14.610197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.610620 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.611949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] PATH_INFO: `/v3/projects/033d74801c2b4491b6a5282da10aef97` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.613635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=033d74801c2b4491b6a5282da10aef97)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:14.624998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:14.723226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:14.751618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033d74801c2b4491b6a5282da10aef97', 'request_id': 'req-a347d39e-773f-475d-8ed3-dcf3a877e06d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.764210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:14.766075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033d74801c2b4491b6a5282da10aef97', 'request_id': 'req-a347d39e-773f-475d-8ed3-dcf3a877e06d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.781852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033d74801c2b4491b6a5282da10aef97', 'request_id': 'req-a347d39e-773f-475d-8ed3-dcf3a877e06d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.806122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a3b6-c3d7-41b1-95cd-6b3f29433696 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:14.811134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] The token cache is being invalidate because project 033d74801c2b4491b6a5282da10aef97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:14.811438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.815152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a347d39e-773f-475d-8ed3-dcf3a877e06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:14.818632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 930/1812] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:14 2022] DELETE /identity/v3/projects/033d74801c2b4491b6a5282da10aef97 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:14.821530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.821818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.822094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.859278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:14.861004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:14.925378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:14.926196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:14.926518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:14.927688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:14.928918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:14.931707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:14.961465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 883/1813] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:14 2022] POST /identity/v3/users => generated 296 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:14.962703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:14.966517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.015950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 931/1814] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:15.017263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.018751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.043209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a162f5-c829-4eb5-99dc-bc520012e736 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.053392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.054478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.055488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.056023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] PATH_INFO: `/v3/users/83b2e7355eea4c8fac79487d63e6b880` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.057732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b2e7355eea4c8fac79487d63e6b880)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.059887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.086921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2d23-5938-40dc-926f-1dd8603bfc47 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.095359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.096230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.096518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.097413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.100606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.117953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.119774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65861c-bda8-462b-a3f8-40780753c14d service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.144818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 884/1815] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:15.147583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.150586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.152033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.171843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b2e7355eea4c8fac79487d63e6b880'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:15.191114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b2e7355eea4c8fac79487d63e6b880'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:15.202591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:15.205626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.225861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b2e7355eea4c8fac79487d63e6b880'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:15.238562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 885/1816] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:15.240318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.242378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.250875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b2e7355eea4c8fac79487d63e6b880'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:15.252248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-066d4c9a-867d-4283-9046-2537778c27a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b2e7355eea4c8fac79487d63e6b880'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:15.257402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d3cd6-8dab-4176-ba26-29f59b83182f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.263801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.264658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.265047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.265475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.266434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.268204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 932/1817] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:15 2022] DELETE /identity/v3/users/83b2e7355eea4c8fac79487d63e6b880 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:15.268537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169a46-8b8b-4321-a0f7-fcec1254cd7c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.274917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.275209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.275509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.286783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 886/1818] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:15.288478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.288787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.289651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.327122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:15.328438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.356788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:15.363030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.448765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:15.472363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 887/1819] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:15.472363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.472363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:15.487188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:15.503331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3647ed1-afdb-44da-a5e0-ad5a3c6dc7f2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.513457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.514873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.515366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.516028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] PATH_INFO: `/v3/projects/b60919ca4bf2423da6fcc0db674b80c5/users/2f63a15779b14456af3ac1dc7da0f4dd/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.541103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60919ca4bf2423da6fcc0db674b80c5, user_id=2f63a15779b14456af3ac1dc7da0f4dd, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.545576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.591650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 888/1820] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:15 2022] PUT /identity/v3/projects/b60919ca4bf2423da6fcc0db674b80c5/users/2f63a15779b14456af3ac1dc7da0f4dd/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:15.591650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.605252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 933/1821] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:15.606500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.634461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349caa9-6f0a-4189-bf3c-f356ec793739 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.727167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.728520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.728985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.729451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.730388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.732500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.741511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdb01f-36e7-4128-89f4-d4bb07a1dbc3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.748636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 934/1822] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:15.749799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.750924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.752851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.753481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.753955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.755430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:15.756185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.760040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.764953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e49f-d4fe-462c-b82c-6f985bfc6779 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.781800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 889/1823] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:15.786609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.791378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.793219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.793643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.794101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.795251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:15.795776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.797809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ffa09-f5a7-4f07-aaac-4f9a8640f573 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.799853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.803182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.804262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.805438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.805561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] PATH_INFO: `/v3/projects/b60919ca4bf2423da6fcc0db674b80c5/users/2f63a15779b14456af3ac1dc7da0f4dd/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.807904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60919ca4bf2423da6fcc0db674b80c5, user_id=2f63a15779b14456af3ac1dc7da0f4dd, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.810700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.823312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 935/1824] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:15.829661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.835904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 890/1825] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:15 2022] PUT /identity/v3/projects/b60919ca4bf2423da6fcc0db674b80c5/users/2f63a15779b14456af3ac1dc7da0f4dd/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:15.838582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:15.866079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636e84-8cd8-4a06-9b8b-5812ba4316dd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.988540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59bb-e8db-4215-8b52-d7f6a647bc3b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:15.994133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.995187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.995310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.995561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:15.996410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:15.998162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:15.998444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323afce-cad5-4478-a92e-c3bc62a97d4b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:15.999045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:15.999543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:15.999973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.000863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.003334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.033886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 891/1826] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:15 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:16.036096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.036610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.037074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.055036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 936/1827] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:15 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:16.056585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.060119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.086107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] MFA Rules not processed for user `2f63a15779b14456af3ac1dc7da0f4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:16.092952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.142190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:16.153460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:16.179228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdc9f6-3cfa-439e-8756-816ad6c6b600 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.188233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.189137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.189478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.189680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] PATH_INFO: `/v3/projects/fb7112962a8640a9b2397bd5d1a24f18` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.192835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7112962a8640a9b2397bd5d1a24f18)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.197167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.200813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 892/1828] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:16.201829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.228593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127ee83-8203-4d0a-87b9-b38c9fb26020 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.243171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.244503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.245701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.246207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.247370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.251586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.279106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 893/1829] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/users => generated 286 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:16.280233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.281278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7112962a8640a9b2397bd5d1a24f18', 'request_id': 'req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:16.289892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7112962a8640a9b2397bd5d1a24f18', 'request_id': 'req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:16.294769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fc249-3113-404b-a221-6095b4e67a50 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.307963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7112962a8640a9b2397bd5d1a24f18', 'request_id': 'req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:16.322426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] The token cache is being invalidate because project fb7112962a8640a9b2397bd5d1a24f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:16.322735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:16.323427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:16.325056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 937/1830] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:16 2022] DELETE /identity/v3/projects/fb7112962a8640a9b2397bd5d1a24f18 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:16.325829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.327290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.369190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.370209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.370693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.370975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.371763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.373720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.394756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eee8-9489-4ff9-bd3b-8b4bfa229a24 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.396292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 894/1831] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:16.397381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.398983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.399107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.399805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.400091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.400372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.402177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.411118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219f9f-924c-4352-91f5-e384550f900b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.416023 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.416701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.416989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.417269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.418010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.419656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af131ec0-af7b-418b-8140-78b30b13b9a9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.430996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 895/1832] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:16.432354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.432650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.432932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.452415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:16.453653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.462527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 896/1833] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:16.463432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.464827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.478417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbcfc6-fbf2-4acd-8b56-9fc54a97b077 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.478641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.480086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.483249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.483963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.484365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.484561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.485442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.487069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487c9d-e2d1-4bf1-9463-8327eb193de4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.490474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 938/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:16.491329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.498603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 897/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:16.500097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.500401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.500700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.504057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b48761-fc3b-4116-a343-4f1fb04b3d0f service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.511263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.512167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.512440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.512716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.513458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.515148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.528701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:16.530453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.534263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 939/1836] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:16.534806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.546905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 898/1837] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:16.547615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41454f-3570-4cce-b2b9-ca0f6db5392d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.548358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.554144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.555147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.555409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.555761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.557371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.559034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.562218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347328-9dea-47fe-8ecc-fc5cd5ef1b79 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.567640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.568574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.568838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.569122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] PATH_INFO: `/v3/projects/7b90fc230da9420d95e5562935b5567f/users/2d2dc55bafa84e5db4cf4774819ea136/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.569973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 940/1838] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:16.570617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.575627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:16.581552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542e09-b612-4299-83b1-f0616c611b0b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.588274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.589566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.589893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.590430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.591183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:16.591297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b90fc230da9420d95e5562935b5567f, user_id=2d2dc55bafa84e5db4cf4774819ea136, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.591749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.594976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.596035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.609418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 941/1839] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:16.610274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.610944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 899/1840] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:16 2022] PUT /identity/v3/projects/7b90fc230da9420d95e5562935b5567f/users/2d2dc55bafa84e5db4cf4774819ea136/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:16.611984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.612089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.624303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4f39-2f1c-43e7-9047-0246206b1b71 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.654828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:16.676903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.677681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdfbb4-4157-4b1b-8bd0-e65099b76614 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.677792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.677994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.678282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.680247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.682548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.683470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.683780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.684064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] PATH_INFO: `/v3/projects/07234e836d704cc69acbf4146e50fc1d/users/c3c31cab61144ee39ce115535a51e270/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.699043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07234e836d704cc69acbf4146e50fc1d, user_id=c3c31cab61144ee39ce115535a51e270, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.701747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.715881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 900/1841] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:16 2022] PUT /identity/v3/projects/07234e836d704cc69acbf4146e50fc1d/users/c3c31cab61144ee39ce115535a51e270/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:16.716686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.749262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.750707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38091c28-44b8-4a5a-85ba-cdb778122f9c service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.760534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 942/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:16.761811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7e546-d3e5-4499-985b-9235f4a560b0 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.762237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7e546-d3e5-4499-985b-9235f4a560b0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.762526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7e546-d3e5-4499-985b-9235f4a560b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.781877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-59d7e546-d3e5-4499-985b-9235f4a560b0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:16.783006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-59d7e546-d3e5-4499-985b-9235f4a560b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.792061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ebcdb-50d5-43ef-8322-b9ee16841462 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.792891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 943/1843] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:16.794149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.794436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.794713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.800540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.801225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.801511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.801793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.802506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:16.804580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:16.834059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 901/1844] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:16.834926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.837275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.842262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] MFA Rules not processed for user `c3c31cab61144ee39ce115535a51e270`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:16.844487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:16.912718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2661c4-0b20-4b4c-87a3-e6b1ec13b301 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:16.923255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:16.924241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:16.924529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:16.924702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 944/1845] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:16.925269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:16.925747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:16.984688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:16.997583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:17.001615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.004540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.021326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 902/1846] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:17.022141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.037012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85d85-c625-46fa-ac44-399ecef694eb service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.041935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c6e4-a07a-464d-962e-451e6fd3c837 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.043512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.044475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.045038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.045567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.046503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.048834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.060040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.060832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.061123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.061406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.062338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.071801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.091138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 903/1847] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:17 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:17.093244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.107037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 945/1848] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:16 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:17.109350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.137362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28419170-6cee-4ba3-aae5-56271dd8439d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.245056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df36a5c-0f26-471b-8e33-56d51cc3650a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.262975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.263898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.264188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.264471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.265197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.270689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.294021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.294842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.295141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.295474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.296391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.298968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.315362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 946/1849] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:17.318360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 904/1850] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:17 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:17.322678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.322862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.344731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d987f-c326-485f-8de3-02f989e24d01 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.355828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.356588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.357036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.357315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.358095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c688-f3c8-4052-9dd9-04359e8f0507 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.359083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.362131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.365969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.367478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.367992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.368943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.369898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.371891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.376304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 905/1851] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:17.380405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.395494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 947/1852] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:17.395494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.413139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0134-cfa9-4cd8-951d-dc02394bca4f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.424156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.424462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cce8d-0a8c-4eaf-bb45-5ce0efaef8ef admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.425521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.426064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.426486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] PATH_INFO: `/v3/projects/f531650da40f43e28da67b8b01ecabf8/users/89fc5d938e21407ba1d428e170a0f4de/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.433069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.434172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.434618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.435011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] PATH_INFO: `/v3/projects/c808832596b34c4092f957963a13f1b7/users/c7af07cd6b554b70897d8c6647ca20ae/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.451040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531650da40f43e28da67b8b01ecabf8, user_id=89fc5d938e21407ba1d428e170a0f4de, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.455865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21e7b0-dbdd-429c-9fd8-96672b316713 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.457133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c808832596b34c4092f957963a13f1b7, user_id=c7af07cd6b554b70897d8c6647ca20ae, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.463069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.483127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 906/1853] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:17 2022] PUT /identity/v3/projects/f531650da40f43e28da67b8b01ecabf8/users/89fc5d938e21407ba1d428e170a0f4de/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:17.494909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.495978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.495978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.512266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 948/1854] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:17 2022] PUT /identity/v3/projects/c808832596b34c4092f957963a13f1b7/users/c7af07cd6b554b70897d8c6647ca20ae/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:17.532661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.548399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] MFA Rules not processed for user `89fc5d938e21407ba1d428e170a0f4de`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:17.548399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:17.631293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4613-9b5b-47e1-afe6-e4b6fb1fc988 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.637417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 907/1855] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:17.646884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.647642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.647897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.649405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.650368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.650756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.652870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.653033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:17.677537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 949/1856] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:17.682366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:17.683012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.696222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d701e-2476-44e7-a9dd-af72ebb8ed57 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.703374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.704981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.705555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.706034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] PATH_INFO: `/v3/projects/c808832596b34c4092f957963a13f1b7/users/c7af07cd6b554b70897d8c6647ca20ae/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.709380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c808832596b34c4092f957963a13f1b7, user_id=c7af07cd6b554b70897d8c6647ca20ae, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.714857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0476ef-585a-4223-9849-beb251ae78a0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.725759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:17.743901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 950/1857] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:17 2022] PUT /identity/v3/projects/c808832596b34c4092f957963a13f1b7/users/c7af07cd6b554b70897d8c6647ca20ae/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:17.749159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.749943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.750291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.784868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bce9f2-afe0-40cc-bd5f-65894144d5c3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.788741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] MFA Rules not processed for user `c7af07cd6b554b70897d8c6647ca20ae`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:17.790423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:17.859849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.860871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.860983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.861189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.887716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 951/1858] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:17.903430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:17.940399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.942063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb15aa-3f8c-45ae-81cc-2b28a87a7599 service glance] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:17.959658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 908/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:17.979713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccf54-22da-4987-a525-f9a8d0700717 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:17.983966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:17.984657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:17.984942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:17.985212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:17.996882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:17.999386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:18.019932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 952/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:18.039509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:18.039995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:18.040475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:18.085035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] MFA Rules not processed for user `2d2dc55bafa84e5db4cf4774819ea136`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:18.091749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:18.102073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:18.119094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eab8fb-f4b7-4463-8eb7-2a987ed229d2 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:18.161133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:18.163196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:18.166183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:18.166779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:18.251426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:18.252329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:18.253432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47e9ca-7e14-451c-8f38-be758639653d service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:18.265464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 909/1861] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:18.274530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 953/1862] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:18.600858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:18.634552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1ac2-e3c8-4122-a128-5fc4cf99486b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:18.652708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:18.653897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:18.654424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:18.654978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:18.668696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:18.670341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:18.682889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 910/1863] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:20.230357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7a9d-f277-49ee-9209-02d127649beb None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:20.230956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7a9d-f277-49ee-9209-02d127649beb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:20.230956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7a9d-f277-49ee-9209-02d127649beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:20.251188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5add7a9d-f277-49ee-9209-02d127649beb None None] MFA Rules not processed for user `2d2dc55bafa84e5db4cf4774819ea136`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:20.252490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5add7a9d-f277-49ee-9209-02d127649beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:20.260298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 954/1864] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:20.768220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:20.770091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:20.923079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b578-3c13-4281-b912-9fed2b34b035 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:20.933604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:20.934679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:20.935745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:20.939939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] PATH_INFO: `/v3/users/fa6b88899b484aba9208dc55593be286` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:20.941456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6b88899b484aba9208dc55593be286)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:20.944465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:21.053151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6b88899b484aba9208dc55593be286'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:21.067617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6b88899b484aba9208dc55593be286'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:21.092301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6b88899b484aba9208dc55593be286'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:21.094882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6b88899b484aba9208dc55593be286'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:21.104011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6b88899b484aba9208dc55593be286'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:21.111616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 911/1865] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:20 2022] DELETE /identity/v3/users/fa6b88899b484aba9208dc55593be286 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:21.116462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:21.116757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:21.117370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:21.156705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:21.159439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:21.201513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:21.325336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 955/1866] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:21.343165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:21.344921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:21.474709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721919c0-10f5-4d77-9ee1-cb020747cfaf admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:21.479742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:21.480416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:21.480704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:21.480989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:21.493325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:21.495469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:21.514748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 912/1867] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:21.903604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:21.905945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:21.930624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4378365-352b-43e5-82ba-c920fecf00d9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:21.936244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:21.937162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:21.937427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:21.937704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] PATH_INFO: `/v3/projects/7f86d1ea19914223b1790236c8fd1845` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:21.939005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f86d1ea19914223b1790236c8fd1845)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:21.941005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:22.005711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f86d1ea19914223b1790236c8fd1845', 'request_id': 'req-4187cf32-8af4-419b-8750-6452906990a9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.015845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f86d1ea19914223b1790236c8fd1845', 'request_id': 'req-4187cf32-8af4-419b-8750-6452906990a9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.022045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f86d1ea19914223b1790236c8fd1845', 'request_id': 'req-4187cf32-8af4-419b-8750-6452906990a9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.033877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] The token cache is being invalidate because project 7f86d1ea19914223b1790236c8fd1845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:22.034268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.034950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4187cf32-8af4-419b-8750-6452906990a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.036576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 956/1868] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:21 2022] DELETE /identity/v3/projects/7f86d1ea19914223b1790236c8fd1845 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:22.041774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:22.057964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820375-c403-4b88-86be-e213e4d88132 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:22.064408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:22.158497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:22.159059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:22.159561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:22.160024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] PATH_INFO: `/v3/users/f2006674b9264bcf848952a1c9b07370` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:22.161994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2006674b9264bcf848952a1c9b07370)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:22.165099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:22.213921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fde0f-4767-45c3-8f7a-9a8e6ec65d00 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:22.214206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fde0f-4767-45c3-8f7a-9a8e6ec65d00 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:22.214474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fde0f-4767-45c3-8f7a-9a8e6ec65d00 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:22.216224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 957/1869] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 14:49:22.233907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:22.234355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:22.234756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:22.245230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2006674b9264bcf848952a1c9b07370'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.258433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:22.260845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:22.262217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2006674b9264bcf848952a1c9b07370'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.293384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2006674b9264bcf848952a1c9b07370'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.294186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2006674b9264bcf848952a1c9b07370'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.313010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2006674b9264bcf848952a1c9b07370'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:22.342958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 913/1870] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:22 2022] DELETE /identity/v3/users/f2006674b9264bcf848952a1c9b07370 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:22.399027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 958/1871] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:22.484417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:22.485928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:22.586131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1132c0-717d-4b4a-b11e-22d9b00efba0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:22.597987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:22.598761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:22.598980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:22.599430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:22.614729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:22.617270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:22.636669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 914/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:22.872835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:22.874527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:22.893878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15f1a3-37c2-4734-ac29-b9a28cfabc20 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:22.983195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:23.013957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:23.014850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:23.015600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:23.015890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] PATH_INFO: `/v3/projects/4b61d497c51e4a2e927265a1e721b7cc` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:23.017203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b61d497c51e4a2e927265a1e721b7cc)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:23.019762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:23.082317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b61d497c51e4a2e927265a1e721b7cc', 'request_id': 'req-e4e37ffe-479b-4708-ae0f-6f97cd545e25'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.095409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b61d497c51e4a2e927265a1e721b7cc', 'request_id': 'req-e4e37ffe-479b-4708-ae0f-6f97cd545e25'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.109068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b61d497c51e4a2e927265a1e721b7cc', 'request_id': 'req-e4e37ffe-479b-4708-ae0f-6f97cd545e25'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.141654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] The token cache is being invalidate because project 4b61d497c51e4a2e927265a1e721b7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:23.142786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.144271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.165751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 959/1873] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:22 2022] DELETE /identity/v3/projects/4b61d497c51e4a2e927265a1e721b7cc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:23.170970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:23.188148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645084-c29b-471d-a93e-3aeeef381bd1 service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:23.208056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:23.347114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:23.348720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:23.349124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:23.350087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] PATH_INFO: `/v3/users/2f63a15779b14456af3ac1dc7da0f4dd` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:23.353245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f63a15779b14456af3ac1dc7da0f4dd)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:23.356147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:23.440632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f63a15779b14456af3ac1dc7da0f4dd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.453877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f63a15779b14456af3ac1dc7da0f4dd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.489264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f63a15779b14456af3ac1dc7da0f4dd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.490027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f63a15779b14456af3ac1dc7da0f4dd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.500596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-efc12a27-44b4-4ba1-a916-4586a59b337a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f63a15779b14456af3ac1dc7da0f4dd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:23.512780 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 915/1874] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:23 2022] DELETE /identity/v3/users/2f63a15779b14456af3ac1dc7da0f4dd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:24.667650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:24.671561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:24.809919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e37ffe-479b-4708-ae0f-6f97cd545e25 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:24.970540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:24.972102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:24.973969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:24.975646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] PATH_INFO: `/v3/projects/b60919ca4bf2423da6fcc0db674b80c5` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:24.980016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60919ca4bf2423da6fcc0db674b80c5)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:24.982634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:25.070536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60919ca4bf2423da6fcc0db674b80c5', 'request_id': 'req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:25.085090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60919ca4bf2423da6fcc0db674b80c5', 'request_id': 'req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:25.102580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60919ca4bf2423da6fcc0db674b80c5', 'request_id': 'req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:25.107053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:25.155412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] The token cache is being invalidate because project b60919ca4bf2423da6fcc0db674b80c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:25.155856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:25.158715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1eb1588c-1236-468a-9f26-fc5b1e7acb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:25.179648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.180560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.180560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.181713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 960/1875] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:24 2022] DELETE /identity/v3/projects/b60919ca4bf2423da6fcc0db674b80c5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:25.216302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:25.220705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:25.329273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.329632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.329959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.331344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 916/1876] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:25.364020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:25.366134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:25.383840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 961/1877] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:25.386903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:25.402781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e308f4-88d5-4f1e-8bd1-88056deaba63 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:25.422233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:25.423026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.423358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.423680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.428082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:25.428469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:25.430174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:25.456881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 917/1878] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:25.457831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:25.473325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9014e-f0b2-4d58-978f-5338f1e6b336 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:25.482597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:25.484952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.485471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.492805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.494164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:25.498546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:25.600813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:25.604813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 962/1879] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:25 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:25.633722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb623e-a1bd-46e9-a919-7f7c67f06b4a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:25.676022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:25.804604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:25.806157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.806157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.806157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.808369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:25.812445 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:25.849619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 918/1880] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:25 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:25.850884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:25.883276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796f50-b392-4e0f-bb4e-0e8244080709 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:25.918752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:25.928930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:25.929148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:25.929472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:25.930411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:25.932940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:25.948334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 963/1881] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:25.952870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:25.986543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cc72c-54f2-4cd1-a829-dc0fc39e73ee admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:26.004263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:26.006362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:26.019810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:26.020757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.022398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.022796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.025471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:26.028069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:26.038528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51890d4-2927-4d04-9341-1dd010623a4b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:26.053463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 919/1882] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:26.055501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:26.056490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.056906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.057253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] PATH_INFO: `/v3/users/c3c31cab61144ee39ce115535a51e270` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.058941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:26.060734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c31cab61144ee39ce115535a51e270)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:26.062836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:26.112862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76742e-3c15-4cd4-a06e-155e86867e41 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:26.132030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:26.137099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.137735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.140818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] PATH_INFO: `/v3/projects/aa4819f43ec84d188a1bcbb9eee06198/users/e5e41c9692b347fbac33e8462a57d212/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.181478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4819f43ec84d188a1bcbb9eee06198, user_id=e5e41c9692b347fbac33e8462a57d212, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:26.185074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ccf4-5baa-45b8-836e-d30144dcd96c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:26.205363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c31cab61144ee39ce115535a51e270'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:26.218529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c31cab61144ee39ce115535a51e270'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:26.221220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 920/1883] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:26 2022] PUT /identity/v3/projects/aa4819f43ec84d188a1bcbb9eee06198/users/e5e41c9692b347fbac33e8462a57d212/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:26.243006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.243729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.244282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.254991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c31cab61144ee39ce115535a51e270'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:26.265364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c31cab61144ee39ce115535a51e270'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:26.266164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7e7858b2-3932-43a8-849f-fc2541fd7c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c31cab61144ee39ce115535a51e270'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:26.278694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 964/1884] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:26 2022] DELETE /identity/v3/users/c3c31cab61144ee39ce115535a51e270 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:26.282038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991923aa-3b49-46a3-bda0-969406300cba None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.282343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991923aa-3b49-46a3-bda0-969406300cba None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.282611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991923aa-3b49-46a3-bda0-969406300cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.288950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] MFA Rules not processed for user `e5e41c9692b347fbac33e8462a57d212`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:26.290674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:26.326892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-991923aa-3b49-46a3-bda0-969406300cba None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:26.330220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-991923aa-3b49-46a3-bda0-969406300cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:26.503325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 921/1885] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:26.523006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:26.525217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:26.546061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 965/1886] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:26.588332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991923aa-3b49-46a3-bda0-969406300cba None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:26.591711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-991923aa-3b49-46a3-bda0-969406300cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:26.626446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6a2a-c9a4-49d9-826e-55abc0a0577a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:26.648625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:26.649224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.649655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.651372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.662083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:26.663716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:26.664906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:26.678395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 922/1887] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:26.707751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991923aa-3b49-46a3-bda0-969406300cba None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:26.712791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:26.714114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:26.714501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:26.714996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:26.730463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:26.732449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:26.751056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 966/1888] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:27.948699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:27.950701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:27.968762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:27.978305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c784d-cbd6-48b3-bd74-5c1c161361e3 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:28.004695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:28.009822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:28.010371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:28.011513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] PATH_INFO: `/v3/projects/07234e836d704cc69acbf4146e50fc1d` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:28.019390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07234e836d704cc69acbf4146e50fc1d)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:28.022806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:28.149301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07234e836d704cc69acbf4146e50fc1d', 'request_id': 'req-f16bf567-8667-4c4b-aebe-ed58d776af8d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.163960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07234e836d704cc69acbf4146e50fc1d', 'request_id': 'req-f16bf567-8667-4c4b-aebe-ed58d776af8d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.188657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07234e836d704cc69acbf4146e50fc1d', 'request_id': 'req-f16bf567-8667-4c4b-aebe-ed58d776af8d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.225343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] The token cache is being invalidate because project 07234e836d704cc69acbf4146e50fc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:28.225772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.228534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.233639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 923/1889] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:27 2022] DELETE /identity/v3/projects/07234e836d704cc69acbf4146e50fc1d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:28.235211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:28.256959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6617d-8a84-49f5-b364-88515fa946b0 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:28.454227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:28.455194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:28.455529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:28.455856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] PATH_INFO: `/v3/users/c7af07cd6b554b70897d8c6647ca20ae` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:28.459486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7af07cd6b554b70897d8c6647ca20ae)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:28.463976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:28.594845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7af07cd6b554b70897d8c6647ca20ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.612652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7af07cd6b554b70897d8c6647ca20ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.642137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7af07cd6b554b70897d8c6647ca20ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.659626 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7af07cd6b554b70897d8c6647ca20ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.660568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22c925e3-55fe-4fdf-9cfc-b36ac26b5f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7af07cd6b554b70897d8c6647ca20ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:28.686592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 967/1890] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:28 2022] DELETE /identity/v3/users/c7af07cd6b554b70897d8c6647ca20ae => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:30.198311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:30.200212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:30.220646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf567-8667-4c4b-aebe-ed58d776af8d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:30.375051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:30.376015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:30.376309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:30.376597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] PATH_INFO: `/v3/projects/c808832596b34c4092f957963a13f1b7` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:30.377971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c808832596b34c4092f957963a13f1b7)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:30.380310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:30.468925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c808832596b34c4092f957963a13f1b7', 'request_id': 'req-4fce94c3-700a-4908-b3f5-423c08f2007c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:30.484607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c808832596b34c4092f957963a13f1b7', 'request_id': 'req-4fce94c3-700a-4908-b3f5-423c08f2007c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:30.494259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c808832596b34c4092f957963a13f1b7', 'request_id': 'req-4fce94c3-700a-4908-b3f5-423c08f2007c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:30.521649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] The token cache is being invalidate because project c808832596b34c4092f957963a13f1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:30.521985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:30.523487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4fce94c3-700a-4908-b3f5-423c08f2007c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:30.526459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 924/1891] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:30 2022] DELETE /identity/v3/projects/c808832596b34c4092f957963a13f1b7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:30.531996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:30.533004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:30.533520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:30.576855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:30.579531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:30.661213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:30.715480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 968/1892] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:30.724165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:30.724503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:30.724957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:30.758994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:30.760748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:30.776737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 925/1893] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:30.777749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:30.790102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7483374-aeb2-49b7-ace1-ea9d127a236c None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:30.806695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:30.808039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:30.808339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:30.808631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:30.809410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:30.809730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:30.814033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:30.827368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 969/1894] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:30.832964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:30.844556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e440f4c-fd11-4a01-a5c7-5f533cf2b2e0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:30.859286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:30.859953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:30.860246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:30.860532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:30.861254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:30.864482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:30.876404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:30.916145 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 926/1895] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:30 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:30.920167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:30.938331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0cfcd-54fd-495c-b78c-29910aa64807 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.032819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.033520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.033803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.034080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.034821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.037542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.068093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 970/1896] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:30 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:31.071100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.084573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadac39-1a0e-4737-94db-8471083f63d6 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.089662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.090612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.090897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.091223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.092195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.094061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.112574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.113806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 927/1897] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:31.126426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1a53-350b-45ac-982c-c8ed20c47dd7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.133022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.133860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.134209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.134559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.135484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.137163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c9e2e-b0c7-4457-8655-2649e9280f7b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.152674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 971/1898] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:31.156932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.174146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e99f5-d718-460f-b691-9a2dab515812 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.191201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.191201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.191201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.191201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] PATH_INFO: `/v3/projects/4d5557143ce1456b9a7868581d489362/users/e98a5f29d53649aabce675ea14e75d94/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.211919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5557143ce1456b9a7868581d489362, user_id=e98a5f29d53649aabce675ea14e75d94, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.215655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.234338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 928/1899] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:31 2022] PUT /identity/v3/projects/4d5557143ce1456b9a7868581d489362/users/e98a5f29d53649aabce675ea14e75d94/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:31.245270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.245567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.245857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.279650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] MFA Rules not processed for user `e98a5f29d53649aabce675ea14e75d94`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:31.281022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:31.360606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 972/1900] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:31.365186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.427164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52cb3-890a-41b6-b002-52c2d9e60855 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.432511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.433182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.433472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.433782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.434488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.436460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.463232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 929/1901] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:31.467749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.480077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595e4a-2710-4fb1-8afa-d675f12276df None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.525403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:31.540459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.541170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.541460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.541731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.542442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.544434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.564551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 973/1902] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:31 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:31.568637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.579144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2565be6-178f-4cc2-8c56-17ab17f7df60 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.584320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.584995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.585803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.586079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.586819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.588482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.599425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 930/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:31.604228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.614125 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722085-417e-416a-a1cb-d71c8b769122 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.618772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.619621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.619902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.620172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] PATH_INFO: `/v3/projects/73526658b9b049a98efc88a72956c4eb/users/48ffe92ad3624695b8f0063ecd1572d2/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.635649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73526658b9b049a98efc88a72956c4eb, user_id=48ffe92ad3624695b8f0063ecd1572d2, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.638466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.652385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 974/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:31 2022] PUT /identity/v3/projects/73526658b9b049a98efc88a72956c4eb/users/48ffe92ad3624695b8f0063ecd1572d2/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:31.656602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.667732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742333-a113-4b61-af98-67b5bd595ac6 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.728176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.729005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.729313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.729698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.730449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.732097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce099-352b-47a1-8dc8-3509cce5e2fd admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.743838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 931/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:31.748726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.761971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef326cf-bd86-43f1-851e-31e03b405d35 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:31.767018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:31.767983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.768264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.768546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] PATH_INFO: `/v3/projects/73526658b9b049a98efc88a72956c4eb/users/48ffe92ad3624695b8f0063ecd1572d2/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.770654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73526658b9b049a98efc88a72956c4eb, user_id=48ffe92ad3624695b8f0063ecd1572d2, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:31.774100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:31.795348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 975/1906] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:31 2022] PUT /identity/v3/projects/73526658b9b049a98efc88a72956c4eb/users/48ffe92ad3624695b8f0063ecd1572d2/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:31.803255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:31.803583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:31.803886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:31.838385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] MFA Rules not processed for user `48ffe92ad3624695b8f0063ecd1572d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:31.839639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:31.854157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:31.928180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 932/1907] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:31.940015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:31.941880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:32.013155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112118f-8e54-41b3-91b8-9ed1ee48747e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:32.017230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:32.017887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:32.018165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:32.018438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:32.029234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:32.030666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c637d4-06a9-4c83-bd82-5c937c927c92 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:32.041164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 976/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:32.068767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:32.153487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459beaa1-d8f4-4d95-90eb-576dfafd164e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:32.161086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:32.164555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:32.164924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:32.165294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] PATH_INFO: `/v3/users/e98a5f29d53649aabce675ea14e75d94` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:32.166884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98a5f29d53649aabce675ea14e75d94)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:32.168779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:32.232481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98a5f29d53649aabce675ea14e75d94'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.240932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98a5f29d53649aabce675ea14e75d94'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.253982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98a5f29d53649aabce675ea14e75d94'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.254678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98a5f29d53649aabce675ea14e75d94'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.264098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98a5f29d53649aabce675ea14e75d94'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.270419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 933/1909] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:32 2022] DELETE /identity/v3/users/e98a5f29d53649aabce675ea14e75d94 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:32.275175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:32.275482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:32.275778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:32.294904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:32.296197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:32.380913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 977/1910] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:32.391985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:32.393526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:32.430507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:32.462420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cddfa-a328-46a4-8e95-f91b1319f8cc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:32.467901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:32.468656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:32.468986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:32.469375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:32.481222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:32.482757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:32.494849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 934/1911] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:32.791693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:32.793159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:32.805893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a74766-7875-4a16-8602-e54ccb4f0fa3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:32.811221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:32.812144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:32.812430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:32.812711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] PATH_INFO: `/v3/projects/4d5557143ce1456b9a7868581d489362` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:32.813938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5557143ce1456b9a7868581d489362)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:32.815953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:32.871886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:32.888414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5557143ce1456b9a7868581d489362', 'request_id': 'req-6eec5760-22e3-4d09-9397-34f4297f7a2b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.898388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5557143ce1456b9a7868581d489362', 'request_id': 'req-6eec5760-22e3-4d09-9397-34f4297f7a2b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.910977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5557143ce1456b9a7868581d489362', 'request_id': 'req-6eec5760-22e3-4d09-9397-34f4297f7a2b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.922872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] The token cache is being invalidate because project 4d5557143ce1456b9a7868581d489362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:32.923162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.923865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:32.925491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 978/1912] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:32 2022] DELETE /identity/v3/projects/4d5557143ce1456b9a7868581d489362 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:32.930629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:32.942872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43395a-57c2-43b4-aede-48a8d666a8ee service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:33.013934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:33.014829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.015119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.015405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] PATH_INFO: `/v3/users/48ffe92ad3624695b8f0063ecd1572d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.016762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ffe92ad3624695b8f0063ecd1572d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:33.018934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:33.077861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ffe92ad3624695b8f0063ecd1572d2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.085599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ffe92ad3624695b8f0063ecd1572d2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.100016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ffe92ad3624695b8f0063ecd1572d2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.100796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ffe92ad3624695b8f0063ecd1572d2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.108487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ffe92ad3624695b8f0063ecd1572d2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.114773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 935/1913] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:32 2022] DELETE /identity/v3/users/48ffe92ad3624695b8f0063ecd1572d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:33.255949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:33.258708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.273073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5760-22e3-4d09-9397-34f4297f7a2b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:33.345089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:33.346004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.346290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.346565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] PATH_INFO: `/v3/users/e5e41c9692b347fbac33e8462a57d212` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.347983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e41c9692b347fbac33e8462a57d212)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:33.349931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:33.400449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e41c9692b347fbac33e8462a57d212'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.408478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e41c9692b347fbac33e8462a57d212'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.426007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:33.426516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e41c9692b347fbac33e8462a57d212'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.427857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.436200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e41c9692b347fbac33e8462a57d212'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.437118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-05ac679c-5981-4127-b95a-ea522a0b43c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e41c9692b347fbac33e8462a57d212'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.444148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affd5f7-2d63-482f-ac10-cbba92973503 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:33.448074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 979/1914] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:33 2022] DELETE /identity/v3/users/e5e41c9692b347fbac33e8462a57d212 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:33.449615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.449917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.450186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.471770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:33.473279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.508469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:33.526599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:33.528543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:33.528771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.529082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.529375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] PATH_INFO: `/v3/projects/73526658b9b049a98efc88a72956c4eb` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.530743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73526658b9b049a98efc88a72956c4eb)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:33.533608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:33.558428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 980/1915] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:33.610288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73526658b9b049a98efc88a72956c4eb', 'request_id': 'req-ad214d24-6329-4872-adf5-b92a24f1f395'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.623738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73526658b9b049a98efc88a72956c4eb', 'request_id': 'req-ad214d24-6329-4872-adf5-b92a24f1f395'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.648996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73526658b9b049a98efc88a72956c4eb', 'request_id': 'req-ad214d24-6329-4872-adf5-b92a24f1f395'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.651781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:33.654029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.698267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] The token cache is being invalidate because project 73526658b9b049a98efc88a72956c4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:33.698940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.700234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ad214d24-6329-4872-adf5-b92a24f1f395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:33.704344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 936/1916] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:33 2022] DELETE /identity/v3/projects/73526658b9b049a98efc88a72956c4eb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:33.708956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1be5-2a4a-4190-bb57-3ddad7eb87f0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.710946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1be5-2a4a-4190-bb57-3ddad7eb87f0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.712069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c1be5-2a4a-4190-bb57-3ddad7eb87f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.742131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-045c1be5-2a4a-4190-bb57-3ddad7eb87f0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:33.744676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-045c1be5-2a4a-4190-bb57-3ddad7eb87f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.830216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 937/1917] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:33.838783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.839594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.840344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.858633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c759bc-19ed-4526-bfd4-a47e6dc6f92d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:33.867855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:33.870201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:33.882342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 938/1918] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:33.887988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:33.914542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9c1f9-f880-44ff-903b-09259c7f821a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:33.929636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:33.933032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:33.933794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:33.934186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:33.936476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:33.937046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:33.940604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:33.959429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 939/1919] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:33.964412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:33.998294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef58d-ff34-4103-b687-b404f5c179bb admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.011963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.013245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.013789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.014194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.015134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.025174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.032565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.033644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.034006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.034234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.053487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:34.073101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 940/1920] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:33 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:34.077234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.111604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.113936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.157536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 981/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:34.164494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:34.211525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0922-d489-452c-a9d8-23171ce489e5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.221821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.223306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.224120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.224757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.226773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.230985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.275534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 941/1922] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:34 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:34.278256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.291848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c48cb-88e8-4c76-b85a-fc3f055e45ed service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.300814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.302500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.304415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.304745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.305553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.307794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.324978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 982/1923] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:34.326078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.346830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883525f6-1790-4f38-bd04-0c3c46955ff8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.374184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.374677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.374874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.375148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.375994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.378440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eefa6a-8e1f-4ce8-b678-e7975d36c80d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.403527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 942/1924] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:34.409014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.421239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a431a-d06f-4efb-85c1-a46fc5b9bc15 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.426637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.427605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.427890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.428165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] PATH_INFO: `/v3/projects/6dff2e63565843c58741cb05617ad558/users/0d7be6e0d3924d65b0dee5e072677f5a/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.453481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dff2e63565843c58741cb05617ad558, user_id=0d7be6e0d3924d65b0dee5e072677f5a, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.456616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.494028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 983/1925] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:34 2022] PUT /identity/v3/projects/6dff2e63565843c58741cb05617ad558/users/0d7be6e0d3924d65b0dee5e072677f5a/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:34.495761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.496584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.497029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.594602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] MFA Rules not processed for user `0d7be6e0d3924d65b0dee5e072677f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:34.596421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:34.748376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 943/1926] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:34.750592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.838588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:34.841369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:34.925072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650d781-bd60-48b0-a009-092a4ba7dcfb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:34.936118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:34.937264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:34.937679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:34.938032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:34.939227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:34.942113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:34.964025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:34.996193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 984/1927] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:34 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:34.997989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.024150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdca3f6-833a-4b78-b157-d45ae4a159b0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.126444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:35.137248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b76d1d-2c85-41e2-8203-34527f566f69 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.146276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.147351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.162855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.164006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] PATH_INFO: `/v3/projects/aa4819f43ec84d188a1bcbb9eee06198` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.164859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.167105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4819f43ec84d188a1bcbb9eee06198)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.168296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.169192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.171395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.172389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.174414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.175231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.253718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 985/1928] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:34 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:35.259168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.294067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56725b-863e-4268-8d5f-859d382eae22 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.326167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4819f43ec84d188a1bcbb9eee06198', 'request_id': 'req-60114866-944c-4683-8a66-47d6a4a114fb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:35.347964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4819f43ec84d188a1bcbb9eee06198', 'request_id': 'req-60114866-944c-4683-8a66-47d6a4a114fb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:35.362200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4819f43ec84d188a1bcbb9eee06198', 'request_id': 'req-60114866-944c-4683-8a66-47d6a4a114fb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:35.390128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] The token cache is being invalidate because project aa4819f43ec84d188a1bcbb9eee06198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:35.390519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:35.391382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-60114866-944c-4683-8a66-47d6a4a114fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:35.393380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 944/1929] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:34 2022] DELETE /identity/v3/projects/aa4819f43ec84d188a1bcbb9eee06198 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:35.400760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f16ee5-093f-4d17-8a5d-6cb3754a5c38 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.401207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f16ee5-093f-4d17-8a5d-6cb3754a5c38 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.402909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f16ee5-093f-4d17-8a5d-6cb3754a5c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.445852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d6f16ee5-093f-4d17-8a5d-6cb3754a5c38 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:35.452725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d6f16ee5-093f-4d17-8a5d-6cb3754a5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:35.476138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.476980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.477379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.480173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.481509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.486051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.501491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 986/1930] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:35.505383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.511720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:35.544001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920f905-29aa-449a-b506-4ce26cacf025 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.555509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.555509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.555509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.555509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] PATH_INFO: `/v3/projects/292ae3ad9fd145f8991571ff062af558/users/18821e5acb5641369c25b542dfbe79c9/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.586657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ae3ad9fd145f8991571ff062af558, user_id=18821e5acb5641369c25b542dfbe79c9, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.589385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.593591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 945/1931] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:35.602318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.602612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.605001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.608706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 987/1932] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:35 2022] PUT /identity/v3/projects/292ae3ad9fd145f8991571ff062af558/users/18821e5acb5641369c25b542dfbe79c9/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:35.612807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.635155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:35.637274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:35.721957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:35.723258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 946/1933] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:35.729641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.739939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238717-37ed-4328-9d57-f2eaf768fd2a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.746835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.747403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.747720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.748001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.748752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.749151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b81b1-7cf7-410d-81fe-1ee17d0a139f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.750377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.754359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.755109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.755403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.755719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.756477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:35.756790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.759838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.763317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 988/1934] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:35.767492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.774665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 947/1935] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:35.783593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a742040-6f63-4a55-9d79-e461b21a71d1 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.784968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.798556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932dca6-f98e-4a0a-aaa3-d5844a21ba06 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.803930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.804571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.805256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.805572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.805856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.805945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.806261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.806569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.806668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] PATH_INFO: `/v3/projects/292ae3ad9fd145f8991571ff062af558/users/18821e5acb5641369c25b542dfbe79c9/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.808890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.810096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292ae3ad9fd145f8991571ff062af558, user_id=18821e5acb5641369c25b542dfbe79c9, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.813661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8dd28-5a43-4758-be0e-e63d31587522 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.821731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:35.833581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 989/1936] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:35 2022] PUT /identity/v3/projects/292ae3ad9fd145f8991571ff062af558/users/18821e5acb5641369c25b542dfbe79c9/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:35.846424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 948/1937] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:35 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:35.846668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.846668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.846668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.849137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.878512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] MFA Rules not processed for user `18821e5acb5641369c25b542dfbe79c9`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:35.879673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:35.928456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16286e90-1510-44d2-b2f4-af17d7302301 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.933950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.934657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.934941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.935225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.935986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.938077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:35.960659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 949/1938] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:35 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:35.965502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.965699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 990/1939] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:35.982016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4bdbc-8540-461b-b454-e4dab2acb25e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:35.984738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:35.986142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:35.988786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:35.989483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:35.989778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:35.990061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:35.990817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:35.993151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.009454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 950/1940] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:36.010427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.024891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ea61-a993-49a7-8810-57d30a494bec admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.032503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.032855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.033146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.033433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.034829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.038619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.063542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 951/1941] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:36.068757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.069059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4798aa-35c5-42bc-9820-1c57eef7341a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.079924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.081090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.081376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.081679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.102094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.103915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2524a5-138f-494a-b620-b51c5b9fb1bb service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.114000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f567b-6a4e-4db6-9e62-b744b9128179 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.118764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 991/1942] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:36.148679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.157838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.158495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.160480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] PATH_INFO: `/v3/projects/6c804a67d15948bcaff55e3a06303d3f/users/b523364e810042ca8d7c791c57e5ca39/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.207039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c804a67d15948bcaff55e3a06303d3f, user_id=b523364e810042ca8d7c791c57e5ca39, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.213460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.234862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 952/1943] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:36 2022] PUT /identity/v3/projects/6c804a67d15948bcaff55e3a06303d3f/users/b523364e810042ca8d7c791c57e5ca39/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:36.246329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.246623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.246903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.318675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] MFA Rules not processed for user `b523364e810042ca8d7c791c57e5ca39`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:36.320473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:36.346362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.432506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:36.448534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 992/1944] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:36.450894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.464099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c7f0-852b-4707-8d15-b1a3c924e117 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.464328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b9f8-b3ce-4706-9bf8-c3a5f3e21e09 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.470663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.471344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.471663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.471769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.472011 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.472651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.472774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.473069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.473349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] PATH_INFO: `/v3/users/0d7be6e0d3924d65b0dee5e072677f5a` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.475362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.477188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7be6e0d3924d65b0dee5e072677f5a)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.481160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.532802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 993/1945] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:36 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:36.537239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.556774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:36.574585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7be6e0d3924d65b0dee5e072677f5a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:36.584893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7be6e0d3924d65b0dee5e072677f5a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:36.600370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7be6e0d3924d65b0dee5e072677f5a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:36.601179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7be6e0d3924d65b0dee5e072677f5a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:36.610485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-bd5af239-b46e-4868-8be5-799ce8e5cc83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7be6e0d3924d65b0dee5e072677f5a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:36.617486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 953/1946] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:36 2022] DELETE /identity/v3/users/0d7be6e0d3924d65b0dee5e072677f5a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:36.622191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.622725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.623238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.623507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d3812-3f25-4c13-ae07-9237e1138fb9 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.644494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:36.646653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:36.693538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.694771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.695118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.695548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.696544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.699098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.743248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 994/1947] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:36 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:36.745844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.748999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:36.777130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f6726-1e13-4e9a-b785-9dc92edac0f0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.777461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 954/1948] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:36.792790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.794407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:36.801365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.802509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.803203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.804674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.807060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.811709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:36.850410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 995/1949] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:36.852932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:36.884059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cd35-9294-4446-ba66-7f5a457e2aae admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:36.905233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:36.912027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:36.912533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:36.914208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] PATH_INFO: `/v3/projects/73b152df634348c6b1874e09948e8bd4/users/3e395846fe1a41a6943e61a8925f9206/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:36.953188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b152df634348c6b1874e09948e8bd4, user_id=3e395846fe1a41a6943e61a8925f9206, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:36.956241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:37.011039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 996/1950] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:36 2022] PUT /identity/v3/projects/73b152df634348c6b1874e09948e8bd4/users/3e395846fe1a41a6943e61a8925f9206/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:37.014973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:37.016769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1610a-230e-40f5-9234-440a5c1695eb None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:37.115255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:37.145704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:37.150244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:37.150691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:37.151038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:37.172691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b3df5-eb06-47eb-8878-1bdd7e2afe8e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:37.178248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:37.178985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:37.179358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:37.179683 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:37.180396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:37.182404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:37.200290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:37.208601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 997/1951] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:37.212743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:37.229054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bdbd7-7fda-46d9-9fb6-2bd28bdcb818 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:37.242006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:37.243514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:37.244201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:37.245831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] PATH_INFO: `/v3/projects/73b152df634348c6b1874e09948e8bd4/users/3e395846fe1a41a6943e61a8925f9206/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:37.248358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b152df634348c6b1874e09948e8bd4, user_id=3e395846fe1a41a6943e61a8925f9206, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:37.252493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0526b-628f-4aa7-8083-f9f915e0ab4c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:37.269683 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 998/1952] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:37 2022] PUT /identity/v3/projects/73b152df634348c6b1874e09948e8bd4/users/3e395846fe1a41a6943e61a8925f9206/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:37.281936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:37.283718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:37.284866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:37.285371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:37.286347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:37.297288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 955/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:37.352141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] MFA Rules not processed for user `3e395846fe1a41a6943e61a8925f9206`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:37.354968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:37.515151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 999/1954] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:37.542621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:37.544223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:37.697485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a24ec-6fc9-4e76-8d68-e6f866da88e2 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:37.762907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:37.763732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:37.764109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:37.764424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:37.767174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:37.885742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:37.887234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:37.910291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 956/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:38.040986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:38.043346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:38.182128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c36ab1-58bf-4ede-83b2-1ff699d83cfd None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:38.187593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:38.188737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:38.189027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:38.189398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] PATH_INFO: `/v3/projects/6dff2e63565843c58741cb05617ad558` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:38.190718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dff2e63565843c58741cb05617ad558)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:38.192821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:38.253103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:38.259557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dff2e63565843c58741cb05617ad558', 'request_id': 'req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.273178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dff2e63565843c58741cb05617ad558', 'request_id': 'req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.281923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dff2e63565843c58741cb05617ad558', 'request_id': 'req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.306644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] The token cache is being invalidate because project 6dff2e63565843c58741cb05617ad558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:38.306978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.307754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.310315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1000/1956] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:38 2022] DELETE /identity/v3/projects/6dff2e63565843c58741cb05617ad558 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:38.317610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:38.347675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83945-b612-4be2-adb8-ad40f5e5dbab service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:38.396494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:38.431597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:38.433813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:38.433813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:38.433813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] PATH_INFO: `/v3/users/18821e5acb5641369c25b542dfbe79c9` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:38.436282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18821e5acb5641369c25b542dfbe79c9)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:38.438751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:38.508047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18821e5acb5641369c25b542dfbe79c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.530907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18821e5acb5641369c25b542dfbe79c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.554469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18821e5acb5641369c25b542dfbe79c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.555746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18821e5acb5641369c25b542dfbe79c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.577905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-707e3bfa-2256-47f1-ae6f-dd3d13b8c1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18821e5acb5641369c25b542dfbe79c9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:38.587508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 957/1957] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:38 2022] DELETE /identity/v3/users/18821e5acb5641369c25b542dfbe79c9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:38.908838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:38.910440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:38.939151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b0e8-c185-4729-a6ce-f1c12548b1d8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.005995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.006914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.007195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.007497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] PATH_INFO: `/v3/projects/292ae3ad9fd145f8991571ff062af558` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.008821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=292ae3ad9fd145f8991571ff062af558)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.010700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.065292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292ae3ad9fd145f8991571ff062af558', 'request_id': 'req-d386cce9-47b6-4524-adc7-d2d9edeb24fb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:39.073556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292ae3ad9fd145f8991571ff062af558', 'request_id': 'req-d386cce9-47b6-4524-adc7-d2d9edeb24fb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:39.080013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292ae3ad9fd145f8991571ff062af558', 'request_id': 'req-d386cce9-47b6-4524-adc7-d2d9edeb24fb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:39.092092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] The token cache is being invalidate because project 292ae3ad9fd145f8991571ff062af558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:39.092411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:39.093072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d386cce9-47b6-4524-adc7-d2d9edeb24fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:39.094648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1001/1958] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:38 2022] DELETE /identity/v3/projects/292ae3ad9fd145f8991571ff062af558 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:39.099596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.100099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.100204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.119421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:39.120792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:39.229357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 958/1959] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:39.238635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.238940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.239228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.260251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:39.261408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:39.270361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1002/1960] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:39.274928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.286194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ee655-d252-4d07-bed0-1088024049c2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.291261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.292641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.292641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.292641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.293646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:39.294063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.295827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.313224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 959/1961] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:39.315712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.325973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce07aba-2b99-46e4-a183-2fe88e5521eb None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.332207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.333149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.333412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.333799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.334713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.337505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.367881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1003/1962] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:39.371378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.382421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4646-e6b0-4656-963f-242b93ce823f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.416093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:39.443121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.443986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.444892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.445175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.445890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.447982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.469764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 960/1963] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:39.473609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.484482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c597f-7d5c-49f8-8f84-5e41b174b4fc admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.489410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.490080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.490363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.490656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.491407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.493029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.507480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1004/1964] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:39.508887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.529456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38db47c-c625-4810-8455-bb32bdb0d090 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.539704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.540200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.540691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.541191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.542451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.544460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb9637-b248-48eb-91df-fcc44099b06c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.561645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 961/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:39.567171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.586070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d42d7-7f88-40fa-b774-d06df0a39a68 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.593400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.594577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.595185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.595704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] PATH_INFO: `/v3/projects/217d19ee1e824ea38684f28dd191d7e2/users/35af76b317b84b1c819ec4fb3608e950/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.622135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217d19ee1e824ea38684f28dd191d7e2, user_id=35af76b317b84b1c819ec4fb3608e950, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.625251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.636383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:39.647961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1005/1966] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:39 2022] PUT /identity/v3/projects/217d19ee1e824ea38684f28dd191d7e2/users/35af76b317b84b1c819ec4fb3608e950/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:39.659358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.659709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.660154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.689912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] MFA Rules not processed for user `35af76b317b84b1c819ec4fb3608e950`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:39.691075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:39.795591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 962/1967] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:39.799824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.905539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d64ac-8675-4e5a-8e43-0cb348544729 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:39.915593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:39.916377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:39.916731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:39.917014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:39.917735 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:39.919950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:39.950641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1006/1968] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:39.954961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:39.967704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad5c8-5cab-49db-ab90-4042834c8ec6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.048846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.049448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.049734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.050072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.050794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.052995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.083437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 963/1969] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:39 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:40.084603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.096075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30782f-1db6-41ef-816d-dafd1e5ec94e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.101239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.101957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.102260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.102542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.103325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.104990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.116202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1007/1970] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:40.120475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.131390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367221-2135-4923-ae55-bf4401e467b5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.136744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.137657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.137954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.138237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] PATH_INFO: `/v3/projects/9ca82d04d2754545a668da4644db56c8/users/f3ca64505e3a47fea3d6b67d3d5ed63e/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.158173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca82d04d2754545a668da4644db56c8, user_id=f3ca64505e3a47fea3d6b67d3d5ed63e, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.161798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.176706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 964/1971] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:40 2022] PUT /identity/v3/projects/9ca82d04d2754545a668da4644db56c8/users/f3ca64505e3a47fea3d6b67d3d5ed63e/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:40.180749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.191410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c0921-37a1-4fc0-96c0-cf4bb0de1cef admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.254283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.254993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.255299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.255605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.256354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.258573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200e955-284f-4ab2-9f27-a9332ab5a015 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.269671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1008/1972] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:40.274608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.286547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442875-55b5-4831-915c-8769115119bb admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.291290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.292233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.292512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.292795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] PATH_INFO: `/v3/projects/9ca82d04d2754545a668da4644db56c8/users/f3ca64505e3a47fea3d6b67d3d5ed63e/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.294805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca82d04d2754545a668da4644db56c8, user_id=f3ca64505e3a47fea3d6b67d3d5ed63e, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.297769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.304103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:40.309913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 965/1973] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:40 2022] PUT /identity/v3/projects/9ca82d04d2754545a668da4644db56c8/users/f3ca64505e3a47fea3d6b67d3d5ed63e/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:40.322474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.322869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.323209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.352383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] MFA Rules not processed for user `f3ca64505e3a47fea3d6b67d3d5ed63e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:40.353609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:40.425158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:40.439330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1009/1974] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:40.453485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.455250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:40.538682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a88fa-299c-4712-a1bd-5083fe0e95fd admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.542684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.543226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.543541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.543829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.554454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.555852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d5b5-58cb-4d90-938b-da22235d6dc3 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.566468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 966/1975] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:40.642166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.644578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:40.717736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86974-6f94-4ed2-9c11-9f3882d08320 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:40.723014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:40.723963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.724247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.724525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] PATH_INFO: `/v3/users/b523364e810042ca8d7c791c57e5ca39` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.726251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b523364e810042ca8d7c791c57e5ca39)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:40.728221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:40.789545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b523364e810042ca8d7c791c57e5ca39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:40.805882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b523364e810042ca8d7c791c57e5ca39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:40.820818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b523364e810042ca8d7c791c57e5ca39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:40.831663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b523364e810042ca8d7c791c57e5ca39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:40.832696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b523364e810042ca8d7c791c57e5ca39'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:40.839668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1010/1976] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:40 2022] DELETE /identity/v3/users/b523364e810042ca8d7c791c57e5ca39 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:40.844538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:40.844898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:40.845118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:40.885249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:40.887892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:40.912372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:40.914541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:40.992792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 967/1977] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:41.003334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.005207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:41.054882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d057f-8e27-4abf-b8c0-8e339fc42423 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.060072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ca64505e3a47fea3d6b67d3d5ed63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca82d04d2754545a668da4644db56c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.060687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.060969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.061263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.062055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:41.062372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.064069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.089951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1011/1978] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:41.094998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.099698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b047-3261-4178-91a5-6cd001234c89 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.104640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.105299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.105584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.105866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.108693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17952c-4951-4c6e-8f0c-c09f5d90bac1 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.115211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ca64505e3a47fea3d6b67d3d5ed63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca82d04d2754545a668da4644db56c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.116022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.116384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.116550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.116844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.117584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.117981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.119722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.129474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 968/1979] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:41.132108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:41.158707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1012/1980] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:41 2022] POST /identity/v3/projects => generated 354 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:41.163108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.176898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de875a05-ed30-4dcc-b4cd-4bfb00c48d0b service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.257279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:41.295443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ca64505e3a47fea3d6b67d3d5ed63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca82d04d2754545a668da4644db56c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.296106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.296418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.296696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.297468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:41.297806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.299489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.316802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 969/1981] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:41.366790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.379167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033410a-cd68-402a-8d91-7ae21e3a0d50 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.400312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ca64505e3a47fea3d6b67d3d5ed63e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ca82d04d2754545a668da4644db56c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.405247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.405563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.405824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] PATH_INFO: `/v3/projects/f9ae4c1436d549bba90c833ca93c864c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.408045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9ae4c1436d549bba90c833ca93c864c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.411348 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.484738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ae4c1436d549bba90c833ca93c864c', 'request_id': 'req-9e2fa074-a49d-4f44-adfb-dbf2625b7794'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.496275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ae4c1436d549bba90c833ca93c864c', 'request_id': 'req-9e2fa074-a49d-4f44-adfb-dbf2625b7794'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.505279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ae4c1436d549bba90c833ca93c864c', 'request_id': 'req-9e2fa074-a49d-4f44-adfb-dbf2625b7794'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.519194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] The token cache is being invalidate because project f9ae4c1436d549bba90c833ca93c864c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:41.519533 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.520263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.523492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1013/1982] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:41 2022] DELETE /identity/v3/projects/f9ae4c1436d549bba90c833ca93c864c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:41.537087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.539494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:41.653053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602669-ee4d-40b4-90e8-bfbfdb774a1c tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.756630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.758049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.758340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.759470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] PATH_INFO: `/v3/projects/6c804a67d15948bcaff55e3a06303d3f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.760168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c804a67d15948bcaff55e3a06303d3f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.762194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.805809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.805809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:41.820177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa074-a49d-4f44-adfb-dbf2625b7794 tempest-VolumeQuotaClassesTest-1543855803 tempest-VolumeQuotaClassesTest-1543855803-project-admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:41.833742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c804a67d15948bcaff55e3a06303d3f', 'request_id': 'req-56f6cb9f-061c-4221-a739-46de79cf4d66'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.844376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c804a67d15948bcaff55e3a06303d3f', 'request_id': 'req-56f6cb9f-061c-4221-a739-46de79cf4d66'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.851770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c804a67d15948bcaff55e3a06303d3f', 'request_id': 'req-56f6cb9f-061c-4221-a739-46de79cf4d66'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.867670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] The token cache is being invalidate because project 6c804a67d15948bcaff55e3a06303d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:41.868192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.869348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.872053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 970/1983] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:41 2022] DELETE /identity/v3/projects/6c804a67d15948bcaff55e3a06303d3f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:41.877286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:41.878829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:41.891100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:41.892192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:41.892545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:41.892899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] PATH_INFO: `/v3/users/35af76b317b84b1c819ec4fb3608e950` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:41.894601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af76b317b84b1c819ec4fb3608e950)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:41.896546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:41.902505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:41.966597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af76b317b84b1c819ec4fb3608e950'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:41.988798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af76b317b84b1c819ec4fb3608e950'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.006378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af76b317b84b1c819ec4fb3608e950'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.008603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:42.016660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6cb9f-061c-4221-a739-46de79cf4d66 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:42.018133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af76b317b84b1c819ec4fb3608e950'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.019733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3e5fcf12-63c8-45ab-9743-afc4e6d7f1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af76b317b84b1c819ec4fb3608e950'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.026477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:42.028357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:42.028724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:42.029422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] PATH_INFO: `/v3/users/3e395846fe1a41a6943e61a8925f9206` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:42.032167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e395846fe1a41a6943e61a8925f9206)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:42.034869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:42.036675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1014/1984] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:41 2022] DELETE /identity/v3/users/35af76b317b84b1c819ec4fb3608e950 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:42.038710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:42.039139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:42.039662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:42.064023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:42.065329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:42.115664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e395846fe1a41a6943e61a8925f9206'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.138081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e395846fe1a41a6943e61a8925f9206'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.167340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e395846fe1a41a6943e61a8925f9206'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.168239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e395846fe1a41a6943e61a8925f9206'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.175943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1015/1985] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:42.190464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e395846fe1a41a6943e61a8925f9206'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.198126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 971/1986] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:41 2022] DELETE /identity/v3/users/3e395846fe1a41a6943e61a8925f9206 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:42.225537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:42.227173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:42.331016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f89f-abc4-4441-bd18-3562513a7896 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:42.411977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:42.412643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:42.413446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:42.413732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:42.518924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:42.522007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:42.523760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb60e6-fc82-43c8-88be-afea229fae6f service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:42.540613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1016/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:42.753947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:42.755699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:42.781453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4815-3faa-476b-92e4-54df93ea6a71 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:42.790397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:42.791069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:42.791324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:42.791641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] PATH_INFO: `/v3/projects/73b152df634348c6b1874e09948e8bd4` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:42.806391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b152df634348c6b1874e09948e8bd4)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:42.808432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:42.900908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b152df634348c6b1874e09948e8bd4', 'request_id': 'req-12170c61-6469-4b20-9284-b22307143693'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.916527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b152df634348c6b1874e09948e8bd4', 'request_id': 'req-12170c61-6469-4b20-9284-b22307143693'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.926124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b152df634348c6b1874e09948e8bd4', 'request_id': 'req-12170c61-6469-4b20-9284-b22307143693'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.956469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] The token cache is being invalidate because project 73b152df634348c6b1874e09948e8bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:42.957169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.961854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:42.965947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 972/1988] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:42 2022] DELETE /identity/v3/projects/73b152df634348c6b1874e09948e8bd4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:42.972413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90cf5-d38b-480d-8fd9-d5aadfd97f29 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:42.973388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90cf5-d38b-480d-8fd9-d5aadfd97f29 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:42.973388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c90cf5-d38b-480d-8fd9-d5aadfd97f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.008824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-93c90cf5-d38b-480d-8fd9-d5aadfd97f29 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:43.010041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-93c90cf5-d38b-480d-8fd9-d5aadfd97f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.074260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.076383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.092649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1017/1989] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:43.098853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:43.108112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.108500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.108797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.133592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:43.134850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.143994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1018/1990] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:43.148065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.159044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d857a-59d2-4290-8e31-0bd388cb25be None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.160604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170c61-6469-4b20-9284-b22307143693 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.164371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.165043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.165328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.165607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.166090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.166358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:43.166672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.167123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.167534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.167989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] PATH_INFO: `/v3/projects/217d19ee1e824ea38684f28dd191d7e2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.168321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.169399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217d19ee1e824ea38684f28dd191d7e2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.171351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.181729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1019/1991] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:43.186089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.196425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1c82-8670-41a6-b935-aa193ee4150d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.201369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.202033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.202317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.202612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.203302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.205295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.230107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217d19ee1e824ea38684f28dd191d7e2', 'request_id': 'req-b85fe311-6e21-4f80-8c2b-38efda629317'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.233397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1020/1992] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:43.237580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.242277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217d19ee1e824ea38684f28dd191d7e2', 'request_id': 'req-b85fe311-6e21-4f80-8c2b-38efda629317'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.251169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217d19ee1e824ea38684f28dd191d7e2', 'request_id': 'req-b85fe311-6e21-4f80-8c2b-38efda629317'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.265393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] The token cache is being invalidate because project 217d19ee1e824ea38684f28dd191d7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:43.265393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.275971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.277819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 973/1993] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:43 2022] DELETE /identity/v3/projects/217d19ee1e824ea38684f28dd191d7e2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:43.282059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.283664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.324603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41fe8e-f2ee-4458-83e0-f5eac877c27f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.330256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.331158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.331473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.331831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.332591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.335292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.365369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1021/1994] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:43.366574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.368324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.373236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fe311-6e21-4f80-8c2b-38efda629317 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.378390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.379212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.379595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.379951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] PATH_INFO: `/v3/users/f3ca64505e3a47fea3d6b67d3d5ed63e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.381233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ca64505e3a47fea3d6b67d3d5ed63e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.383053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf40e-5a35-4abe-972c-a3947fe73ceb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.383300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.389105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.389844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.390018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.390933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.391088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.392914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.409157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1022/1995] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:43.410961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.426380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21791867-8444-44e3-980a-cb26769dd84d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.433826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.434900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.435390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.435688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.436456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.438450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.450340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1023/1996] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:43.454108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ca64505e3a47fea3d6b67d3d5ed63e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.454731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.458033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:43.467865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ca64505e3a47fea3d6b67d3d5ed63e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.469144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c61d7-c7bd-4791-b5cd-62e5ebb12ccf admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.474601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.476375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.476756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.477103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] PATH_INFO: `/v3/projects/8081c6ba60e04b3687e40b7f0a5dac99/users/9780380755d84609b70d2ab5843b6876/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.486306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ca64505e3a47fea3d6b67d3d5ed63e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.487668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ca64505e3a47fea3d6b67d3d5ed63e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.494311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8081c6ba60e04b3687e40b7f0a5dac99, user_id=9780380755d84609b70d2ab5843b6876, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.496271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-67a58c15-b674-4282-a863-c8caa2cb6349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ca64505e3a47fea3d6b67d3d5ed63e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:43.498527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.507285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 974/1997] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:43 2022] DELETE /identity/v3/users/f3ca64505e3a47fea3d6b67d3d5ed63e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:43.514070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:43.523389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1024/1998] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:43 2022] PUT /identity/v3/projects/8081c6ba60e04b3687e40b7f0a5dac99/users/9780380755d84609b70d2ab5843b6876/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:43.535763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.536067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.536354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.568281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] MFA Rules not processed for user `9780380755d84609b70d2ab5843b6876`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:43.569641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.709338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 975/1999] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:43.714261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.716381 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:43.844519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94a367-8312-4910-939d-ce78dc91cf71 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.853301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:43.854429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:43.854908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:43.855338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:43.856577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:43.859434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:43.916046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1025/2000] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:43.917270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.933980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb27615-dfad-4acd-8db4-38aca48ff99f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:43.974378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:43.976154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.031567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.032560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.032850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.033127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.034783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.037138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.081379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989f6a-b1f8-4fcd-9f00-0890fe8885f4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.087880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 976/2001] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:43 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:44.091811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.092572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.094856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.095157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.095434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] PATH_INFO: `/v3/projects/9ca82d04d2754545a668da4644db56c8` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.097199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca82d04d2754545a668da4644db56c8)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.099349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.120309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a5f4d-6db4-4e0a-b274-ecc6c27ad11a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.127359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.128317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.128747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.129166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.130106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.136315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.166446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 977/2002] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:44.172365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.190767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394a5f-d1b7-4a55-9dfb-dd114654bdb0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.201050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca82d04d2754545a668da4644db56c8', 'request_id': 'req-b4891132-9c61-4899-b2a8-71caf285e7a7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.220628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca82d04d2754545a668da4644db56c8', 'request_id': 'req-b4891132-9c61-4899-b2a8-71caf285e7a7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.248071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca82d04d2754545a668da4644db56c8', 'request_id': 'req-b4891132-9c61-4899-b2a8-71caf285e7a7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.280323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:44.310434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] The token cache is being invalidate because project 9ca82d04d2754545a668da4644db56c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:44.310979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.311616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b4891132-9c61-4899-b2a8-71caf285e7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.316364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1026/2003] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:43 2022] DELETE /identity/v3/projects/9ca82d04d2754545a668da4644db56c8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:44.325210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.326468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.326733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a733b-22e0-4d0f-8db0-000978acf84f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.326887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.327244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a733b-22e0-4d0f-8db0-000978acf84f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.327481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.328854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.329267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a733b-22e0-4d0f-8db0-000978acf84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.333019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.354675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 978/2004] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:44.359079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.362604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.377203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36dada-b963-43e2-b24b-e7430c7e3307 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.388418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.390138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.390950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.390950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] PATH_INFO: `/v3/projects/2b24bb9936604e0a935695ba3b4970e3/users/3689d942b9cc4fe5aea3c4fdd2bfc890/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.395530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9c6a733b-22e0-4d0f-8db0-000978acf84f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:44.397891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9c6a733b-22e0-4d0f-8db0-000978acf84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.407888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1027/2005] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:44.411144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b24bb9936604e0a935695ba3b4970e3, user_id=3689d942b9cc4fe5aea3c4fdd2bfc890, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.415006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd0fac-6ad4-4847-b116-9b4756f7f9ae admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.417093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.417519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.417808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.432589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 979/2006] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:44 2022] PUT /identity/v3/projects/2b24bb9936604e0a935695ba3b4970e3/users/3689d942b9cc4fe5aea3c4fdd2bfc890/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:44.442966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:44.445711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.446212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.446778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.455532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:44.461798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.516484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] MFA Rules not processed for user `3689d942b9cc4fe5aea3c4fdd2bfc890`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:44.523089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.559443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1028/2007] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:44.565159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.584814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6080b-6720-41c4-b3a2-5588b68a65ba None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.590977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.591622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.591909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.592187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.592947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:44.593259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.594921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.611400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1029/2008] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:44.613367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.622236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 980/2009] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:44.626858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.631384 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6da59-c956-4ad7-bde1-371bd3e18d50 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.637521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.638190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.638540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.638812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343422e-3ae8-4d41-9cc2-3f75803b5e8a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.638912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.639708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.641761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.643986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.644724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.645237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.645527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.646277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.648379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.671914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1030/2010] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:44.676170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.681832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 981/2011] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:44.685736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.743112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75b1c-0153-4635-87a5-564b1e78311d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.769388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b25b-6898-412a-88cb-291e2285ed20 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.774260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.774973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.775421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.775831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.776562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.778852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.805038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 982/2012] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:44.806534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.808423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.812388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.813167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.813526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.813877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.814656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.816886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.818215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:44.823676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc271c6-5349-4d92-9a95-58bbe62cf7de admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.832088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.833118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.833792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.834088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] PATH_INFO: `/v3/users/89fc5d938e21407ba1d428e170a0f4de` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.835983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fc5d938e21407ba1d428e170a0f4de)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.838115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.842091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1031/2013] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:44 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:44.843019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.857555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def82dfb-d05e-49d5-97fb-f268bf812c4f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.863729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.864918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.865203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.865481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.866985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.869454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.875916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:44.882273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1032/2014] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:44.882933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.900988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55110d5c-1eb6-407c-8983-1724aaaed13e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.907240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.907965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.908254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.908610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.909409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.911343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:44.911617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fc5d938e21407ba1d428e170a0f4de'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.926619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fc5d938e21407ba1d428e170a0f4de'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.930788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1033/2015] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:44.932108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.943564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8d09-a975-4f8a-8c12-bfb5eefe7f59 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:44.946839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fc5d938e21407ba1d428e170a0f4de'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.947441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fc5d938e21407ba1d428e170a0f4de'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.950967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:44.952253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:44.952536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:44.952995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] PATH_INFO: `/v3/projects/d887a82210a24f029846a61ee1440e22/users/82d78b69181345259dfa7d09c72e2397/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:44.961092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fc5d938e21407ba1d428e170a0f4de'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:44.980545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 983/2016] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:44 2022] DELETE /identity/v3/users/89fc5d938e21407ba1d428e170a0f4de => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:44.982249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:44.985549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d887a82210a24f029846a61ee1440e22, user_id=82d78b69181345259dfa7d09c72e2397, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:44.988238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:44.994340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6583f7-775d-41d4-b4a4-748f156a03d2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.031611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1034/2017] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:44 2022] PUT /identity/v3/projects/d887a82210a24f029846a61ee1440e22/users/82d78b69181345259dfa7d09c72e2397/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:45.033126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.033581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.033962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.072322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:45.073877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.149683 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1035/2018] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:45.151028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.151584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f653-9d6a-4acb-bbf5-a9799c708b17 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.153769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.164234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.165028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.165324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.165844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.166503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.174773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.181611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cfee2-b03c-4145-8c07-d42b4160034f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.193696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 984/2019] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:45.195519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.196367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.196751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.197041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.197871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.199404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.201670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.227713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca141b-771b-4933-87ae-2dc735b6c3d3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.231297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1036/2020] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:45.235880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.238771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.241634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.242677 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.242953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.243234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] PATH_INFO: `/v3/projects/6e9ead24fd4d44b7a2b8857b1b4bcdd7/users/6735922c4469485190b3e415405006ed/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.268713 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9ead24fd4d44b7a2b8857b1b4bcdd7, user_id=6735922c4469485190b3e415405006ed, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.272708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.304346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 985/2021] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:45 2022] PUT /identity/v3/projects/6e9ead24fd4d44b7a2b8857b1b4bcdd7/users/6735922c4469485190b3e415405006ed/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:45.304346 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.337040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f8e1b-278b-42aa-aa01-285315ec7c2a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.418847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:45.425744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.426783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.427257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.427569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.457329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:45.468183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f9bd-28af-4af0-9504-d65afa6ed79a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.485697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.487403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.487985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.488442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] PATH_INFO: `/v3/projects/d887a82210a24f029846a61ee1440e22/users/82d78b69181345259dfa7d09c72e2397/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.493605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d887a82210a24f029846a61ee1440e22, user_id=82d78b69181345259dfa7d09c72e2397, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.499360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5774e14-2b13-48ac-a3d9-a6d64c2acf57 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.524797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 986/2022] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:45 2022] PUT /identity/v3/projects/d887a82210a24f029846a61ee1440e22/users/82d78b69181345259dfa7d09c72e2397/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:45.535711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.535711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.535711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.553496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.555070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8210-8448-4324-9529-bb65a751a9c0 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.573592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1037/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:45.575331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.575658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.575939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.582320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] MFA Rules not processed for user `6735922c4469485190b3e415405006ed`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:45.583937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.611930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] MFA Rules not processed for user `82d78b69181345259dfa7d09c72e2397`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:45.613433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.664692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 987/2024] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:45.669688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.720438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1038/2025] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:45.733024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.734911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.777657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2324636-9a3d-46d8-9c74-54278b4e2595 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.787414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.789691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.791034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.791864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.792920 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.797167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.823078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edbb42-e40d-4919-b265-5ddd22f623cc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.828513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.829210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.829499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.829777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.833343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:45.856589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 988/2026] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:45 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:45.857753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:45.953737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.959595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.961793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:45.966536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebebea-2420-4a7e-a6a0-efed00ae7ca3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:45.973372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:45.975595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:45.976126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:45.976514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:45.976843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:45.977852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:45.979680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:45.990779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1039/2027] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:46.007509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 989/2028] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:45 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:46.009713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:46.026838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e92a4-ecae-4f6b-b5a5-f6fc85d87b68 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:46.033729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:46.034705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.034993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.035330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.036211 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:46.038137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:46.050519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1040/2029] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:46.054929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:46.068188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6172a1-165c-4728-97cb-a88d2a223134 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:46.074443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:46.075633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.076345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.076856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] PATH_INFO: `/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0/users/d089fc997c1c4bd3b3413e209b5a7d34/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.098355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e1d30fa1f42fb8932014bdd87d6a0, user_id=d089fc997c1c4bd3b3413e209b5a7d34, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:46.102491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:46.133795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:46.135294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 990/2030] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:46 2022] PUT /identity/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0/users/d089fc997c1c4bd3b3413e209b5a7d34/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:46.146131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98635193-fa38-47c3-89ea-40b1e5940ede admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:46.267543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:46.269058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.271095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.271653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.275074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:46.278944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54061b1-2ca1-42f9-9d27-39508740eaa0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:46.307540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1041/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:46.311532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:46.325829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214797f-72c3-4305-bc02-2a9dfddaca59 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:46.331512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:46.332943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.333454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.333936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] PATH_INFO: `/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0/users/d089fc997c1c4bd3b3413e209b5a7d34/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.338833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59e1d30fa1f42fb8932014bdd87d6a0, user_id=d089fc997c1c4bd3b3413e209b5a7d34, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:46.342716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:46.358726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 991/2032] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:46 2022] PUT /identity/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0/users/d089fc997c1c4bd3b3413e209b5a7d34/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:46.372166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.372470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.372732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.412473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] MFA Rules not processed for user `d089fc997c1c4bd3b3413e209b5a7d34`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:46.415899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:46.652943 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1042/2033] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:46.665729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:46.773914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86e03-c8db-44e8-9695-199b94571cdf admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:46.779468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:46.780233 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:46.780525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:46.780806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:46.800544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:46.808841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:46.847634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 992/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:46.988575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.001678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e96901-2715-43d5-a0d3-732c08b7b74a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:47.010268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:47.011676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.011968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.012251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.170454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:47.174640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf068e-9fe3-47a6-881e-61e19c7cbd35 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:47.193681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1043/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:47.201827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.206716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:47.316689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0791c2-b3fd-443d-821a-a8bc567bc735 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:47.333614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:47.339115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.339510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.339802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] PATH_INFO: `/v3/projects/f531650da40f43e28da67b8b01ecabf8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.348816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f531650da40f43e28da67b8b01ecabf8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:47.350873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:47.470982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f531650da40f43e28da67b8b01ecabf8', 'request_id': 'req-455ad830-0608-46df-8b0e-8fe441998afb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:47.477309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:47.482490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f531650da40f43e28da67b8b01ecabf8', 'request_id': 'req-455ad830-0608-46df-8b0e-8fe441998afb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:47.494403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f531650da40f43e28da67b8b01ecabf8', 'request_id': 'req-455ad830-0608-46df-8b0e-8fe441998afb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:47.515261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] The token cache is being invalidate because project f531650da40f43e28da67b8b01ecabf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:47.515786 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:47.517134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-455ad830-0608-46df-8b0e-8fe441998afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:47.519345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 993/2036] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:47 2022] DELETE /identity/v3/projects/f531650da40f43e28da67b8b01ecabf8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:47.525407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.528150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.528682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.548235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:47.558126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:47.560265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:47.650166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1044/2037] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:47.662696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.662696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.662696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.706814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:47.708341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:47.742130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.747855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 994/2038] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:47.757471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464e09d-dc58-45ba-9a27-049b1f65a9ea None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:47.775207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:47.776680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.777330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.777845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.778865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:47.779342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:47.782392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:47.834539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1045/2039] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:49:47.839933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.855433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d43d-c81b-4906-954e-a75c70eff21c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:47.878063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:47.878763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:47.879098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:47.879321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:47.880081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:47.882719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:47.946617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 995/2040] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:47 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:49:47.950830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.967283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a6ce-3250-4129-a440-a8504042cfab admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:47.969757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:47.971615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:48.050450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3cda-0ae3-48be-89c1-ce8046a94a7c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:48.054546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.055304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.055627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.055909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.056714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.058100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.058889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.059280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.059390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.060120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.063092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:48.114848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1046/2041] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:47 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:48.117917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:48.142310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb168d1-96ef-49af-86df-a93b07b5f705 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:48.152688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.153680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.154176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.155532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.156629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.167843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.182750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.185428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.198825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1047/2042] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:48.200432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:48.217107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771982d7-7f7b-4573-8798-2f2f97dfa56a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:48.219397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 996/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:48.223845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.224767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.225473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.225954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.227055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.229688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c16b1-0f87-4e2a-8408-e2bc6c5f98a4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.243609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1048/2044] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:48.248423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:48.264594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c837e3-941a-4780-802a-2842da9b3f85 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:48.269957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.270982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.271357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.271727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] PATH_INFO: `/v3/projects/288f83165665447d9a1300c145b4f4e9/users/f6652a5e3703476a9521dce4cb746cab/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.294344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=288f83165665447d9a1300c145b4f4e9, user_id=f6652a5e3703476a9521dce4cb746cab, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.298099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.324092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 997/2045] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:48 2022] PUT /identity/v3/projects/288f83165665447d9a1300c145b4f4e9/users/f6652a5e3703476a9521dce4cb746cab/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:48.334318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.335239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.335708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.369987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] MFA Rules not processed for user `f6652a5e3703476a9521dce4cb746cab`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:48.371931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:48.453863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:48.485760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1049/2046] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:48.522563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:48.524979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:48.628111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:48.653730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c571-c27b-4fa6-9dec-ab3e7dab0c0d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:48.659134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:48.660201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:48.660806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:48.661275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:48.684358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:48.690015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:48.713756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 998/2047] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:49.334830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:49.353670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6e838-49c8-45d7-9955-4abbcbfcaa06 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:49.362366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:49.366881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:49.367176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:49.368608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:49.372852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:49.471177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:49.472530 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8eb4-0cf5-4071-bd5b-d2592b1b3218 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:49.488114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1050/2048] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:50.592453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:50.594535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:50.701965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884700a-db19-4195-8863-97a2dc4c0ada service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:50.717544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:50.718521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:50.718811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:50.719089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] PATH_INFO: `/v3/users/6735922c4469485190b3e415405006ed` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:50.721926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6735922c4469485190b3e415405006ed)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:50.728352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:50.848680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6735922c4469485190b3e415405006ed'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:50.865436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6735922c4469485190b3e415405006ed'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:50.903730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6735922c4469485190b3e415405006ed'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:50.907326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6735922c4469485190b3e415405006ed'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:50.919347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6735922c4469485190b3e415405006ed'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:50.926913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 999/2049] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:50 2022] DELETE /identity/v3/users/6735922c4469485190b3e415405006ed => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:50.931770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:50.932307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:50.932632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:50.953272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:50.954563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:51.072174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1051/2050] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:51.078761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:51.081804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:51.247418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4cacb-6374-46be-9990-51f8a234e97a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:51.260052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:51.260747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:51.261038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:51.261315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:51.289152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:51.291859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:51.307169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1000/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:51.808415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:51.815361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:51.843524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beb0c-14c9-49ca-b489-d2790a452309 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:51.853461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:51.855651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:51.856042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:51.856421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] PATH_INFO: `/v3/projects/6e9ead24fd4d44b7a2b8857b1b4bcdd7` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:51.857856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9ead24fd4d44b7a2b8857b1b4bcdd7)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:51.860010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:51.938628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9ead24fd4d44b7a2b8857b1b4bcdd7', 'request_id': 'req-162d4f1f-96c3-405b-90f0-77d7566675b6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:51.950767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9ead24fd4d44b7a2b8857b1b4bcdd7', 'request_id': 'req-162d4f1f-96c3-405b-90f0-77d7566675b6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:51.960317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9ead24fd4d44b7a2b8857b1b4bcdd7', 'request_id': 'req-162d4f1f-96c3-405b-90f0-77d7566675b6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:51.977072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] The token cache is being invalidate because project 6e9ead24fd4d44b7a2b8857b1b4bcdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:51.977378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:51.978087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:51.982818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1052/2052] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:51 2022] DELETE /identity/v3/projects/6e9ead24fd4d44b7a2b8857b1b4bcdd7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:51.984148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:51.997364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b823-7ffb-46de-a45c-a9ef3c2dde4a service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:52.007772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:52.101772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:52.103351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:52.103725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:52.104113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] PATH_INFO: `/v3/users/d089fc997c1c4bd3b3413e209b5a7d34` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:52.105781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d089fc997c1c4bd3b3413e209b5a7d34)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:52.107790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:52.177774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd089fc997c1c4bd3b3413e209b5a7d34'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.188629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd089fc997c1c4bd3b3413e209b5a7d34'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.204923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd089fc997c1c4bd3b3413e209b5a7d34'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.205930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd089fc997c1c4bd3b3413e209b5a7d34'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.218687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-466f6586-ff8f-4116-82c6-d89664a55089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd089fc997c1c4bd3b3413e209b5a7d34'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.227910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1001/2053] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:51 2022] DELETE /identity/v3/users/d089fc997c1c4bd3b3413e209b5a7d34 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:52.629125 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:52.631059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:52.657963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4f1f-96c3-405b-90f0-77d7566675b6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:52.674831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:52.787306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:52.788730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:52.789228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:52.789642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] PATH_INFO: `/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:52.793202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59e1d30fa1f42fb8932014bdd87d6a0)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:52.797206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:52.906685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59e1d30fa1f42fb8932014bdd87d6a0', 'request_id': 'req-26ab2f93-39a4-4965-97f3-452c9a77e1ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.919173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59e1d30fa1f42fb8932014bdd87d6a0', 'request_id': 'req-26ab2f93-39a4-4965-97f3-452c9a77e1ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.932204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59e1d30fa1f42fb8932014bdd87d6a0', 'request_id': 'req-26ab2f93-39a4-4965-97f3-452c9a77e1ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.956040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] The token cache is being invalidate because project f59e1d30fa1f42fb8932014bdd87d6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:52.957956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.959238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-26ab2f93-39a4-4965-97f3-452c9a77e1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:52.962035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1053/2054] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:52 2022] DELETE /identity/v3/projects/f59e1d30fa1f42fb8932014bdd87d6a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:52.968688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:52.969058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:52.969474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:52.992757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:52.994263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:53.067013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1002/2055] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:53.075662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.076044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.076413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.096981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:53.098368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:53.108384 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1054/2056] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:53.114578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.127055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14746-de91-40ea-b3b0-920e805e6898 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.132782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.133752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.134044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.134329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.135103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:53.135422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.137243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.155505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1003/2057] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:53.160133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.188614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38ffb8-9c17-4679-839a-de7cf787d152 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.199439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.200170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.200456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.200829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.201575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.204387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.253880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1055/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:53.258215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.278234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60b2e-2ad4-453f-bc37-3200d83ce712 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.294050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:53.366286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.366988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.367279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.367609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.368426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.370405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.399538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1004/2059] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:53.400932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.412674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a141-f0aa-49e6-ae8a-00d423f33291 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.419477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.420190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.421124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.421625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.422889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.424612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.437068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1056/2060] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:53.441250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.455812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcb3db-863e-44ef-9685-9d7c01ef7a98 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.461394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.462144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.462530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.462701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.463483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.465371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2133-de84-41e4-9c8c-5be27cca9513 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.481687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1005/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:53.486417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.497347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f47cb-ca51-44ff-90e4-e37a77271877 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.503766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.504677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.505015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.505290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] PATH_INFO: `/v3/projects/db385086939143bc8151f9bbc9cc102a/users/b9b20e6369114f479a945a7abf247590/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.523957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] RBAC: Authorizing `identity:create_grant(project_id=db385086939143bc8151f9bbc9cc102a, user_id=b9b20e6369114f479a945a7abf247590, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.527520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.547714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1057/2062] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:53 2022] PUT /identity/v3/projects/db385086939143bc8151f9bbc9cc102a/users/b9b20e6369114f479a945a7abf247590/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:53.556364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.556665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.556960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.604511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] MFA Rules not processed for user `b9b20e6369114f479a945a7abf247590`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:53.607132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:53.717092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1006/2063] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:53.722361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.773738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:53.803006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bce68-ed2b-4202-9d9e-a7e583278add admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.808047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:53.808701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:53.809276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:53.809276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:53.810018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:53.811963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:53.856033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.863637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1058/2064] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:53.877298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed40c4f-a496-4acd-864b-f88341b1059d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:53.979019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:53.981655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.006063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.006063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.006063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.006063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.007364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.007364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.033533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1007/2065] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:53 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:54.040354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.057005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1baa8-1328-4802-a8a9-1b39dc5e252a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.063342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.064945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.064945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.064945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.065708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.067415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.083501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1008/2066] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:54.084762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.090844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:54.097267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d696-f45f-4515-b9c7-ce35a83c053d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.103102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253393e-7520-457c-8f9a-9846060a4e99 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.106597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.107913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.108357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.109131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] PATH_INFO: `/v3/projects/7ba2b613b259406883692c624ab885f2/users/24061eba3b254d609a5a7fe4d64338ff/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.113830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.115065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.116693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.117325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] PATH_INFO: `/v3/users/9780380755d84609b70d2ab5843b6876` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.119966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9780380755d84609b70d2ab5843b6876)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.123354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.133047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba2b613b259406883692c624ab885f2, user_id=24061eba3b254d609a5a7fe4d64338ff, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.135666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.161534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1009/2067] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:54 2022] PUT /identity/v3/projects/7ba2b613b259406883692c624ab885f2/users/24061eba3b254d609a5a7fe4d64338ff/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:54.163366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.208682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9780380755d84609b70d2ab5843b6876'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:54.223008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9780380755d84609b70d2ab5843b6876'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:54.260725 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9780380755d84609b70d2ab5843b6876'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:54.279220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9780380755d84609b70d2ab5843b6876'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:54.281082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3f0d8265-9b21-4566-8627-2eeb621e147c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9780380755d84609b70d2ab5843b6876'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:54.298635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1059/2068] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:53 2022] DELETE /identity/v3/users/9780380755d84609b70d2ab5843b6876 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:54.304219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.304516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.304805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.328645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5699c-cc06-47ed-b63b-04e481c343be admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.343346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:54.345019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.411469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:54.434242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.434877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.435165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.435476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.436300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.437940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.462292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1010/2069] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:54.466647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.468566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.473313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1060/2070] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:54.483806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6391-e765-4149-a0e8-7d62695c60f5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.490621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.492916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.502049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.503078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.503370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.503685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] PATH_INFO: `/v3/projects/7ba2b613b259406883692c624ab885f2/users/24061eba3b254d609a5a7fe4d64338ff/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.511624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba2b613b259406883692c624ab885f2, user_id=24061eba3b254d609a5a7fe4d64338ff, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.518448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f890a5-f92a-4170-bc43-591e8ba849e7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.550358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1011/2071] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:54 2022] PUT /identity/v3/projects/7ba2b613b259406883692c624ab885f2/users/24061eba3b254d609a5a7fe4d64338ff/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:49:54.561118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.561452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.561692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.614350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] MFA Rules not processed for user `24061eba3b254d609a5a7fe4d64338ff`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:54.614350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.616538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef769a3-e3e6-455b-8bef-0bada63e760b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.680623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.681826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.682470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.682956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.724406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:54.751321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1012/2072] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:54.763644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:54.769153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.789542 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.791230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:54.815925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1061/2073] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:54.847057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3fd7-1276-4b72-9a35-4e7974e79bba None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:54.852129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:54.852815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:54.853099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:54.853379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:54.860620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:54.995595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:54.997366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:55.029661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1013/2074] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:49:55.844483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:55.846167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:55.871593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403762-de0f-4d0b-b04c-8751a6b06990 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:55.884266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:55.892806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:55.893108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:55.893393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] PATH_INFO: `/v3/projects/8081c6ba60e04b3687e40b7f0a5dac99` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:55.901983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8081c6ba60e04b3687e40b7f0a5dac99)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:55.906364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:55.973865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:55.986426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8081c6ba60e04b3687e40b7f0a5dac99', 'request_id': 'req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:55.999321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8081c6ba60e04b3687e40b7f0a5dac99', 'request_id': 'req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.010372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8081c6ba60e04b3687e40b7f0a5dac99', 'request_id': 'req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.027900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] The token cache is being invalidate because project 8081c6ba60e04b3687e40b7f0a5dac99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:56.028487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.029394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-099ca712-deb9-4575-b5b8-5cd9a9c7f6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.034050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1062/2075] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:55 2022] DELETE /identity/v3/projects/8081c6ba60e04b3687e40b7f0a5dac99 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:56.035261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:56.047761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035f47-529f-479c-9c93-8e06e648ff40 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:56.114119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:56.115022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:56.115310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:56.116257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] PATH_INFO: `/v3/users/3689d942b9cc4fe5aea3c4fdd2bfc890` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:56.117528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3689d942b9cc4fe5aea3c4fdd2bfc890)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:56.119515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:56.182817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3689d942b9cc4fe5aea3c4fdd2bfc890'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.186588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:56.196410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3689d942b9cc4fe5aea3c4fdd2bfc890'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.217227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3689d942b9cc4fe5aea3c4fdd2bfc890'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.217972 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3689d942b9cc4fe5aea3c4fdd2bfc890'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.227279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3689d942b9cc4fe5aea3c4fdd2bfc890'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.234681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1014/2076] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:56 2022] DELETE /identity/v3/users/3689d942b9cc4fe5aea3c4fdd2bfc890 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:56.295368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:56.295681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:56.299662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:56.328927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] MFA Rules not processed for user `2d2dc55bafa84e5db4cf4774819ea136`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:56.330285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:56.423638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1063/2077] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:56.636753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:56.639077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:56.744278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63a00-f948-43ca-9e84-a26282223abe admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:56.750174 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:56.751741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:56.751741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:56.752227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] PATH_INFO: `/v3/projects/2b24bb9936604e0a935695ba3b4970e3` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:56.753684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b24bb9936604e0a935695ba3b4970e3)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:56.755818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:56.838029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b24bb9936604e0a935695ba3b4970e3', 'request_id': 'req-9689beaa-8278-47ca-bf4a-fc2818c479e7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.856071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b24bb9936604e0a935695ba3b4970e3', 'request_id': 'req-9689beaa-8278-47ca-bf4a-fc2818c479e7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.868138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b24bb9936604e0a935695ba3b4970e3', 'request_id': 'req-9689beaa-8278-47ca-bf4a-fc2818c479e7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.887207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] The token cache is being invalidate because project 2b24bb9936604e0a935695ba3b4970e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:56.887547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.888229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9689beaa-8278-47ca-bf4a-fc2818c479e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:56.889829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1015/2078] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:56 2022] DELETE /identity/v3/projects/2b24bb9936604e0a935695ba3b4970e3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:56.894526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:56.916235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2869-5931-4ece-9491-6cd6a72d22c6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:57.044628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:57.045934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:57.046422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:57.047075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] PATH_INFO: `/v3/users/82d78b69181345259dfa7d09c72e2397` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:57.049129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d78b69181345259dfa7d09c72e2397)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:57.053902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:57.139827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d78b69181345259dfa7d09c72e2397'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.152322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d78b69181345259dfa7d09c72e2397'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.171652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d78b69181345259dfa7d09c72e2397'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.181904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:57.184868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d78b69181345259dfa7d09c72e2397'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.186134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d78b69181345259dfa7d09c72e2397'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.220445 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef951bd-423d-45e6-a36a-e640e1b7c062 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:57.220955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef951bd-423d-45e6-a36a-e640e1b7c062 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:57.221037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef951bd-423d-45e6-a36a-e640e1b7c062 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:57.223830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1016/2080] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:49:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:49:57.226118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1064/2080] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:56 2022] DELETE /identity/v3/users/82d78b69181345259dfa7d09c72e2397 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:57.237497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:57.238975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:57.239409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:57.289243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:57.295703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:57.351251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:57.352850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:57.393012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:57.421843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1017/2081] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:57.440314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:57.446513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:57.490342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20016f98-0537-4d24-8a3c-a737fe3f4180 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:57.509270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:57.510322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:57.510660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:57.511474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:57.547053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:57.550158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ac3a9-ee5e-43be-ac14-d263f0065f67 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:57.551267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:57.561599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:57.563052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:57.563565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:57.563967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] PATH_INFO: `/v3/users/9c158757829f47a2b698f86eb682430d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:57.566926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1018/2082] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:57.567087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c158757829f47a2b698f86eb682430d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:57.569408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:57.679324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c158757829f47a2b698f86eb682430d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.693106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c158757829f47a2b698f86eb682430d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.725905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c158757829f47a2b698f86eb682430d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.740095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c158757829f47a2b698f86eb682430d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.740957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c158757829f47a2b698f86eb682430d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:57.749639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1065/2083] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:49:57 2022] DELETE /identity/v3/users/9c158757829f47a2b698f86eb682430d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:57.892925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:57.894512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:57.912202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cab4a0-d579-463c-a991-479dc945c446 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:57.988395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:57.989971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:58.000727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.002032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.002325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.003802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] PATH_INFO: `/v3/projects/d887a82210a24f029846a61ee1440e22` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.005602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d887a82210a24f029846a61ee1440e22)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.008827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.081883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd887a82210a24f029846a61ee1440e22', 'request_id': 'req-066dc5d6-0934-4a58-b2f7-f224bc228ef6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.092548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f002-eabf-49df-8d41-8abe0b6ab02a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.094725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd887a82210a24f029846a61ee1440e22', 'request_id': 'req-066dc5d6-0934-4a58-b2f7-f224bc228ef6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.105309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd887a82210a24f029846a61ee1440e22', 'request_id': 'req-066dc5d6-0934-4a58-b2f7-f224bc228ef6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.122429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:58.130943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] The token cache is being invalidate because project d887a82210a24f029846a61ee1440e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:58.135712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.138528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-066dc5d6-0934-4a58-b2f7-f224bc228ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.143436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1019/2084] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:57 2022] DELETE /identity/v3/projects/d887a82210a24f029846a61ee1440e22 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:58.150522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e23a2-1daf-4793-a0df-e055cf75520c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.150837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e23a2-1daf-4793-a0df-e055cf75520c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.151127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e23a2-1daf-4793-a0df-e055cf75520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.175339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-030e23a2-1daf-4793-a0df-e055cf75520c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:58.176893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-030e23a2-1daf-4793-a0df-e055cf75520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:58.200511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.202153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.202589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.203140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] PATH_INFO: `/v3/projects/3263f4157b784011b02fef1e1f285345` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.205039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3263f4157b784011b02fef1e1f285345)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.207179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.253459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1020/2085] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:58.262105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.262391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.262673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.282079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:58.283323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:58.291008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:58.293375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3263f4157b784011b02fef1e1f285345', 'request_id': 'req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.300442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3263f4157b784011b02fef1e1f285345', 'request_id': 'req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.308752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3263f4157b784011b02fef1e1f285345', 'request_id': 'req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.326426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] The token cache is being invalidate because project 3263f4157b784011b02fef1e1f285345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:49:58.326721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.327393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a0b3d808-a37e-4181-bc53-10cfc17fb2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:49:58.329038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1066/2086] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:49:57 2022] DELETE /identity/v3/projects/3263f4157b784011b02fef1e1f285345 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:58.334328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5927-4ce1-47d1-a097-a9f2ea70b87a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.334624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5927-4ce1-47d1-a097-a9f2ea70b87a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.335818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5927-4ce1-47d1-a097-a9f2ea70b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.357127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1021/2087] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:58.359029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-417e5927-4ce1-47d1-a097-a9f2ea70b87a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:58.361225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.363633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-417e5927-4ce1-47d1-a097-a9f2ea70b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:58.374691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe37b9-8ac4-4c77-86d4-d45935a2a0b8 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.381240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.382021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.382399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.382721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.383619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:58.384015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.387628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.392046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1067/2088] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:49:58.400822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.401012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.401984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.410707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1022/2089] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:58.413307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.424639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:58.425551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba99f1-0eab-4993-8e68-a0504cb1f476 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.425863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:58.431418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.432343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.432825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.433532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.434459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.434942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1068/2090] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:58.437192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.439527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.453251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bcba0-f874-4f77-906b-734e153531a6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.459764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.460545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.460871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.461237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.462057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:49:58.462492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.464354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.470502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1023/2091] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:58.474981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.483982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1069/2092] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:49:58.485472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.496379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c31d85-1238-4530-9756-2293f919c5a7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.560946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587185b-617f-46c6-90e3-50b6f4332531 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.566784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.567514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.567855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.568171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.569124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.570495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.570918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.571274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.571598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.571876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.572571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.574466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.594816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1024/2093] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:58.599682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.607515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1070/2094] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:58.613714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.616260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc617-ae55-4827-a7c0-dbe3cf974c0e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.625129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:58.680518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.681332 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.681684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.682042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.682795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.684440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.694089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e6d6-e021-4bb4-bc01-87e861709c40 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.695264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1025/2095] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:58.699237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.701720 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.702408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.702710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.702971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.703718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.704488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:58.707614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.713671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b6ef1-b677-4e35-8b0d-fea96241618c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.722956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.723676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.723960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.724271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.725571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.727299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.735265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1071/2096] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:49:58.740299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.755085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1026/2097] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:58.755293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521a473-c5f2-466b-809b-a0cdb581fd21 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.759863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.765071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.768446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.768875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.769238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.770472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.773605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.786870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1072/2098] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:49:58.788512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8de89-e7a9-4ca2-a028-20dd7c6b0f07 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.791024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.801966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.802888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.803253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.803586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] PATH_INFO: `/v3/projects/f89d2c26ed6444e3a6992842e8b2c30f/users/113a056d964347468584ffadb2d73686/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.811682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72724678-c0ec-4205-9230-9983f119d164 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.826956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:58.827677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.827963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.828359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.829362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.831746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.846700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89d2c26ed6444e3a6992842e8b2c30f, user_id=113a056d964347468584ffadb2d73686, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:58.849894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e7bc-97ac-4237-b738-20b0f59838f8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:58.861476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1073/2099] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:49:58.866637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:58.875074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1027/2100] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:58 2022] PUT /identity/v3/projects/f89d2c26ed6444e3a6992842e8b2c30f/users/113a056d964347468584ffadb2d73686/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:58.884935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2edff-8735-490d-bbd8-7e7dea5fa73f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:58.890630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:58.891207 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:58.891756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:58.981192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] MFA Rules not processed for user `113a056d964347468584ffadb2d73686`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:58.982651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:59.020501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:59.021420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:59.023064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:59.023064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] PATH_INFO: `/v3/projects/32db3ea2bb1c4916a13d8e84516d892b/users/f55464cab54a428a8f069ba32b825fdb/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:59.055564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32db3ea2bb1c4916a13d8e84516d892b, user_id=f55464cab54a428a8f069ba32b825fdb, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:59.060549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f38183-e161-41a3-980f-cdc3b235e2b0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:59.089225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1074/2101] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:49:58 2022] PUT /identity/v3/projects/32db3ea2bb1c4916a13d8e84516d892b/users/f55464cab54a428a8f069ba32b825fdb/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:49:59.093666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:59.095848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:59.096051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:59.127870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:49:59.129767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:59.133619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1028/2102] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:59.146398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:59.154496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:59.208330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:59.226569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1075/2103] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:49:59.236222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:49:59.239504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:49:59.246413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4cc88-3b20-4857-9066-c761b067391f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:59.309935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:59.310639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:59.310887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:59.311161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:59.344807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:49:59.358827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb67726-3662-4ba8-9476-45b20a2cb908 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:49:59.369669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:49:59.370788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:49:59.371651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:49:59.372151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:49:59.402704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:59.404398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda09957-78e8-4399-a4e6-c7034e0258a2 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:59.406420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:49:59.408068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:49:59.430875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1076/2104] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:49:59.432696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1029/2105] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:00.349397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.349914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.350047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.385107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] MFA Rules not processed for user `f55464cab54a428a8f069ba32b825fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:00.386879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:00.511410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1077/2106] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:00.540038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.559027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c954-ca24-415d-b486-3885728a91da service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.565180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:00.565961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.566322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.566765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.568151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:00.570762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:00.615394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.630952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16de8a8-2146-4daa-986a-52a5bf6b5d21 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.636752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:00.637700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1030/2107] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:00 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:00.638176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.638654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.639053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.639389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.642431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:00.728500 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1010-9dc8-41a2-8c6f-0d43a354db79 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.730424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:00.732423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:00.734222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:00.735017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.735380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.735768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.736555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:00.739197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:00.744230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1078/2108] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:50:00.767490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1031/2109] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:00 2022] POST /identity/v3/users => generated 308 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:00.771270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.786337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6e91-2196-4b12-a697-73a47c4466bc service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.794631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:00.794631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.794974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.795595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.796558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:00.799183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:00.814838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1079/2110] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:00.816599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.836503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365c0e-f637-4d6a-8fb6-b9882c9e3d75 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.843575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:00.844829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.845255 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.845538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] PATH_INFO: `/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51/users/9e8ae54975364495837c6596576c00df/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.866976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b26ae4280e47518ee5d5e22d4d9f51, user_id=9e8ae54975364495837c6596576c00df, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:00.870134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124e658-f910-4bf8-a0aa-261cc69b6f88 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:00.892217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1032/2111] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:00 2022] PUT /identity/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51/users/9e8ae54975364495837c6596576c00df/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:00.898226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:00.916171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:00.916171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:00.917467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:00.923150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63e5e-ad79-487c-a354-eab012b80c01 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:00.951802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] MFA Rules not processed for user `113a056d964347468584ffadb2d73686`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:00.953137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:00.958962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:01.024147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:01.024913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:01.025204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:01.027691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:01.027817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1033/2112] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:01.030645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:01.032335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ddc2e-bc71-4ad0-9efe-baa07bbe9736 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:01.047032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1080/2113] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:01.052365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:01.069999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962e03-2e2a-4f9d-a878-1e5d88ed61d6 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:01.077470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:01.078360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:01.078734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:01.079018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] PATH_INFO: `/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51/users/9e8ae54975364495837c6596576c00df/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:01.094270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b26ae4280e47518ee5d5e22d4d9f51, user_id=9e8ae54975364495837c6596576c00df, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:01.100285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95a044-fe8e-48b8-a05c-1813fb880ac7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:01.120327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1034/2114] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:01 2022] PUT /identity/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51/users/9e8ae54975364495837c6596576c00df/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:02.148651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb042-b6e1-4bab-9c27-e1bcf89d73c3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:02.149059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb042-b6e1-4bab-9c27-e1bcf89d73c3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:02.149226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb042-b6e1-4bab-9c27-e1bcf89d73c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:02.192752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5b9bb042-b6e1-4bab-9c27-e1bcf89d73c3 None None] MFA Rules not processed for user `9e8ae54975364495837c6596576c00df`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:02.194623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5b9bb042-b6e1-4bab-9c27-e1bcf89d73c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:02.292263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1081/2115] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:03.081377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:03.081889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:03.081976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:03.083548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1035/2116] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:50:03.118058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:03.118385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:03.118638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:03.137223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] MFA Rules not processed for user `90ce225267684e4b89e38e76fe317aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:03.138493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:03.236014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1082/2117] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:03.250875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:03.252665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:03.271282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:03.279678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87a74-080f-41ed-9d0f-34c823f0fed0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:03.287926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:03.288625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:03.289082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:03.289363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:03.300742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:03.302369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:03.315344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1036/2118] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:03.852079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:03.897312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:03.939577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776a36-d9bd-4f57-bd44-d900d0e9b3ec None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:03.945467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:03.946452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:03.946815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:03.947204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] PATH_INFO: `/v3/users/f55464cab54a428a8f069ba32b825fdb` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:03.949142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55464cab54a428a8f069ba32b825fdb)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:03.951229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:04.007398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55464cab54a428a8f069ba32b825fdb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.015843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55464cab54a428a8f069ba32b825fdb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.031149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55464cab54a428a8f069ba32b825fdb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.039882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55464cab54a428a8f069ba32b825fdb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.040535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55464cab54a428a8f069ba32b825fdb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.048498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1083/2119] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:03 2022] DELETE /identity/v3/users/f55464cab54a428a8f069ba32b825fdb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:04.230393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:04.242903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c1e9f-3d4e-4a06-b1ed-65277cd2a82a service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:04.319645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:04.320454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:04.320743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:04.321021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] PATH_INFO: `/v3/projects/32db3ea2bb1c4916a13d8e84516d892b` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:04.322227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32db3ea2bb1c4916a13d8e84516d892b)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:04.324252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:04.373518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32db3ea2bb1c4916a13d8e84516d892b', 'request_id': 'req-202b2046-5f88-4b0a-879d-bb04d0df8220'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.380867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32db3ea2bb1c4916a13d8e84516d892b', 'request_id': 'req-202b2046-5f88-4b0a-879d-bb04d0df8220'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.387055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32db3ea2bb1c4916a13d8e84516d892b', 'request_id': 'req-202b2046-5f88-4b0a-879d-bb04d0df8220'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.399607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] The token cache is being invalidate because project 32db3ea2bb1c4916a13d8e84516d892b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:04.399902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.400572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.402119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1037/2120] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:04 2022] DELETE /identity/v3/projects/32db3ea2bb1c4916a13d8e84516d892b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:04.406240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:04.407918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:04.423946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3195f-ba26-4d75-9a3d-0d6141758a74 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:04.487636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:04.488558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:04.488858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:04.489142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] PATH_INFO: `/v3/users/9e8ae54975364495837c6596576c00df` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:04.490924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8ae54975364495837c6596576c00df)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:04.493198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:04.561870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8ae54975364495837c6596576c00df'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.569562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8ae54975364495837c6596576c00df'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.572332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:04.594176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8ae54975364495837c6596576c00df'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.603485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8ae54975364495837c6596576c00df'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.604331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-22042a1e-f30d-47b1-9fdc-999adf262487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8ae54975364495837c6596576c00df'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:04.614824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1084/2121] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:04 2022] DELETE /identity/v3/users/9e8ae54975364495837c6596576c00df => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:04.852720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:04.854371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:04.877662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2046-5f88-4b0a-879d-bb04d0df8220 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:04.958673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:04.960161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:04.960585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:04.960871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] PATH_INFO: `/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:04.962159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b26ae4280e47518ee5d5e22d4d9f51)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:04.964128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:04.989021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:05.024600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b26ae4280e47518ee5d5e22d4d9f51', 'request_id': 'req-c6cde92d-e460-4a1e-8d41-80623e525f55'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:05.037039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b26ae4280e47518ee5d5e22d4d9f51', 'request_id': 'req-c6cde92d-e460-4a1e-8d41-80623e525f55'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:05.045319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b26ae4280e47518ee5d5e22d4d9f51', 'request_id': 'req-c6cde92d-e460-4a1e-8d41-80623e525f55'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:05.056900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] The token cache is being invalidate because project d8b26ae4280e47518ee5d5e22d4d9f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:05.057199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:05.057929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6cde92d-e460-4a1e-8d41-80623e525f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:05.059764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1038/2122] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:04 2022] DELETE /identity/v3/projects/d8b26ae4280e47518ee5d5e22d4d9f51 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:05.064858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.065177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.066554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.084695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:05.085879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:05.169123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1085/2123] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:05.178012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.178310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.178601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.200168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:05.201465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:05.210490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1039/2124] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:05.214627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.225433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e1813-e403-44fc-8285-91ebafc02c66 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.230199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.230855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.231140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.231418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.232198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:05.232508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.234109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.245636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1086/2125] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:05.250101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.260766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723b23-edc5-423a-bf34-2032a683f06e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.265640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.266311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.266600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.266881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.267625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.269536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.299985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1040/2126] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:50:05.301717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.324827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fae02-1354-47ba-b42f-c67cbba18763 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.432499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.433222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.433719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.434010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.435080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.437433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.473391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.482493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1087/2127] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:05.487113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699efe-4a99-47b0-b3ba-0febd39d8bac admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.492835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.493544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.494353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.494525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.495393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.497296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.512143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1041/2128] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:05.516408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.540187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679e90c-0afb-41a1-96d0-34dc9673dda4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.545905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.546603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.546941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.547231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.548069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.549839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc364b-cf84-4ff2-9ab4-9facfe686bfc admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.571507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1088/2129] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:05.574079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.606315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15635-ea60-480e-8542-ee5c08c56b22 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.622940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.624799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.625230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.625541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] PATH_INFO: `/v3/projects/a540fb590db24c679c910913522d8bb2/users/9f1bccc61e0d461899f34564d1985b4c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.643323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a540fb590db24c679c910913522d8bb2, user_id=9f1bccc61e0d461899f34564d1985b4c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.646092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.666265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1042/2130] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:05 2022] PUT /identity/v3/projects/a540fb590db24c679c910913522d8bb2/users/9f1bccc61e0d461899f34564d1985b4c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:05.681459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.681783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.682306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.721345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] MFA Rules not processed for user `9f1bccc61e0d461899f34564d1985b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:05.723114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:05.760578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:05.805552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1089/2131] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:05.809888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.893401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b2c7-a697-4d36-96be-65cf13c83613 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.899256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:05.899996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:05.900283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:05.900570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:05.901309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:05.903495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:05.938594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1043/2132] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:50:05.942454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.951361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:05.953664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:05.962960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990a9a1-2963-4587-bf6b-79e8041dedf2 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:05.994914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:06.035821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540d953-b5c5-49bd-8421-eaaca77eef6d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.042005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.043273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.043775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.044180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] PATH_INFO: `/v3/users/b9b20e6369114f479a945a7abf247590` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.045733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b20e6369114f479a945a7abf247590)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.047993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.054575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.055294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.055518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.055806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.056793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.058871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.081764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1090/2133] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:05 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:06.085703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.097539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749d4f2-c0cc-46e4-a028-e026e3b2144b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.106792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.107591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.107955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.108303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.109130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.110823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.123302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1091/2134] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:06.129824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.130512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b20e6369114f479a945a7abf247590'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:06.144427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b20e6369114f479a945a7abf247590'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:06.152268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c5ac4-e67b-4dd5-aabd-40eb1cdab0fd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.162890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.162890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.162890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.163425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] PATH_INFO: `/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23/users/f0d938d66c584191a1d63461398a7ffc/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.173409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b20e6369114f479a945a7abf247590'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:06.175720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b20e6369114f479a945a7abf247590'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:06.190910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-99b59b63-884b-45c2-9e06-56f5f1d7d28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b20e6369114f479a945a7abf247590'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:06.206301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1044/2135] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:05 2022] DELETE /identity/v3/users/b9b20e6369114f479a945a7abf247590 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:06.210932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.211224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.211578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.225080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c5bf76fec545f7bb53001fbeb91b23, user_id=f0d938d66c584191a1d63461398a7ffc, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.230605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.242988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:06.244329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.272827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1092/2136] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:06 2022] PUT /identity/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23/users/f0d938d66c584191a1d63461398a7ffc/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:06.277327 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.281581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.341550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1045/2137] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:06.355030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.356756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.392625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95084f2-baa3-44b3-b2af-8bc4b2e02829 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.403801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.404602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.404956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.405304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.406716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.408909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.423755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1093/2138] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:06.427516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.433845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e756-f19a-49b2-a0a5-d52af75f0367 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.439889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:06.441331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56137-d3df-44ba-a839-f3a4ffd2b7ca admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.447423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.448000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.448336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.448933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] PATH_INFO: `/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23/users/f0d938d66c584191a1d63461398a7ffc/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.450714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c5bf76fec545f7bb53001fbeb91b23, user_id=f0d938d66c584191a1d63461398a7ffc, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.454603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7dfaa-7c80-4bba-b7b5-be12b0bb9420 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.466998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1094/2139] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:06 2022] PUT /identity/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23/users/f0d938d66c584191a1d63461398a7ffc/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:06.478858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.479287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.479412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.489706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:06.523110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.523352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] MFA Rules not processed for user `f0d938d66c584191a1d63461398a7ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:06.524491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.524680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.524964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.525336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.562305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.563953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.576775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1046/2140] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:50:06.635527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1095/2141] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:06.651585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.653413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.743624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb97e-8956-4471-b850-cb563674325c service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.818603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.819431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.819769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.820053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:06.831192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:06.832688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:06.844917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1047/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:06.959498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.989788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afbbf-92db-4228-8e58-538a8445add6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:06.993915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:06.995550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:06.995980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:06.997774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:06.998331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:06.998812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:07.001610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:07.095102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:07.096616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:07.121448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1096/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:07.122439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65861f-a4d0-465d-ad70-91ca4bd6ee75 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:07.143808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:07.145051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:07.145965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:07.148313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] PATH_INFO: `/v3/projects/db385086939143bc8151f9bbc9cc102a` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:07.151955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db385086939143bc8151f9bbc9cc102a)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:07.154119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:07.167407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:07.222840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db385086939143bc8151f9bbc9cc102a', 'request_id': 'req-fd7832ce-e0a5-46c8-bf0f-cd686f646022'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.233112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db385086939143bc8151f9bbc9cc102a', 'request_id': 'req-fd7832ce-e0a5-46c8-bf0f-cd686f646022'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.241815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db385086939143bc8151f9bbc9cc102a', 'request_id': 'req-fd7832ce-e0a5-46c8-bf0f-cd686f646022'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.255353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] The token cache is being invalidate because project db385086939143bc8151f9bbc9cc102a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:07.255660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.257105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.258829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1048/2144] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:06 2022] DELETE /identity/v3/projects/db385086939143bc8151f9bbc9cc102a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:07.262730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:07.276635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c0da-d3fa-40d7-8eb4-6aa151f21e31 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:07.361566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:07.362527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:07.362807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:07.363127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] PATH_INFO: `/v3/users/24061eba3b254d609a5a7fe4d64338ff` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:07.364452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24061eba3b254d609a5a7fe4d64338ff)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:07.366481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:07.404276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:07.418746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24061eba3b254d609a5a7fe4d64338ff'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.425869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24061eba3b254d609a5a7fe4d64338ff'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.438082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24061eba3b254d609a5a7fe4d64338ff'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.445275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24061eba3b254d609a5a7fe4d64338ff'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.446000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-35c67bf8-060f-4c9c-a4c4-d03d06303ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24061eba3b254d609a5a7fe4d64338ff'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:07.451971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1097/2145] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:07 2022] DELETE /identity/v3/users/24061eba3b254d609a5a7fe4d64338ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:08.090806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.092330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:08.115061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7832ce-e0a5-46c8-bf0f-cd686f646022 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.207896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.208317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.208603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.208897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] PATH_INFO: `/v3/projects/7ba2b613b259406883692c624ab885f2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.211575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba2b613b259406883692c624ab885f2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.213396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:08.296720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba2b613b259406883692c624ab885f2', 'request_id': 'req-57add73d-a42a-4f34-874c-aa4b30d937fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:08.311868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba2b613b259406883692c624ab885f2', 'request_id': 'req-57add73d-a42a-4f34-874c-aa4b30d937fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:08.336870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba2b613b259406883692c624ab885f2', 'request_id': 'req-57add73d-a42a-4f34-874c-aa4b30d937fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:08.359790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] The token cache is being invalidate because project 7ba2b613b259406883692c624ab885f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:08.360089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:08.363321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-57add73d-a42a-4f34-874c-aa4b30d937fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:08.366064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1049/2146] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:08 2022] DELETE /identity/v3/projects/7ba2b613b259406883692c624ab885f2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:08.373789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.373789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.373789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.409601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:08.413672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:08.571227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1098/2147] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:08.573017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.573309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.573591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.604794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:08.606467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:08.626246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1050/2148] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:08.627612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.641101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483e16-6d96-48ad-88dc-d1b14695868f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.646143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.647378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.647694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.647947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.648785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:08.649056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.650612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:08.674512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1099/2149] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:08.678796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.688817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1bc17-53dc-4770-a719-239bbcab2377 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.694872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.695595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.695877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.696155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.697033 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.698955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:08.725710 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:08.741693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.743519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1051/2150] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:08 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:08.753668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf737df-9206-4c0e-948e-76258695bcb1 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.860407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.861406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.861765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.862107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.862973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.865636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:08.901495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1100/2151] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:08 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:50:08.904608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.918915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4ef6f-d5db-4719-9d45-927313de5691 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.941072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.942050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.944551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.944928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.945602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.947324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:08.965119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1052/2152] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:08.969374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:08.980648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbae1d0-cff1-40ba-84fa-50fb9e3d83e6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:08.992961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:08.993667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:08.993958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:08.994239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:08.995003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:08.997351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f98a7a-74d9-457b-b789-084b1dc73ebf admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.037943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.038906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1101/2153] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:09.053829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230f5f-ecc5-42e1-a793-ade8c6a183ea admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.058898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.059842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.060123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.060396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] PATH_INFO: `/v3/projects/5552d647baf648cdaf00a4edf2e1f938/users/221c0df45be144cfa9ef970a9e28b2cb/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.080253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5552d647baf648cdaf00a4edf2e1f938, user_id=221c0df45be144cfa9ef970a9e28b2cb, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.083012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.107498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1053/2154] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:09 2022] PUT /identity/v3/projects/5552d647baf648cdaf00a4edf2e1f938/users/221c0df45be144cfa9ef970a9e28b2cb/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:09.179842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.180202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.180435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.207113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:09.212898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] MFA Rules not processed for user `221c0df45be144cfa9ef970a9e28b2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:09.214344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:09.307850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1102/2155] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:09.312494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.408544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ccf7d-2e64-48a5-b84a-e22d96630969 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.413715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.414375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.414660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.414936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.415681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.417573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.445408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1054/2156] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:09.449474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.460834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775abeef-f4c9-424f-85dd-715ab8e75f44 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.552107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.553484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.553840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.554292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.554968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.557046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.591172 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1103/2157] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:09.593392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.604650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c9be-35f8-482f-8b19-48dabf692a65 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.611482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.611482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.611482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.614631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.614631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.614886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.627161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1055/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:09.631894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.644755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58d138-ea03-4b9d-879b-54929d01b52e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.650651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.651337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.651673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.652094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.652856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.654504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0c20c-37db-4c40-b740-dd7e2da69040 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.668473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1104/2159] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:09.672901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.685788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ba54-70e9-46b3-8909-fafd669a5155 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.692281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.693245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.693533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.693821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] PATH_INFO: `/v3/projects/3620d686879444cb9a1edae217b0d035/users/e6bdec75e0c44f90b8bd9f2fbabb7435/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.712613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3620d686879444cb9a1edae217b0d035, user_id=e6bdec75e0c44f90b8bd9f2fbabb7435, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.715730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.731247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1056/2160] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:09 2022] PUT /identity/v3/projects/3620d686879444cb9a1edae217b0d035/users/e6bdec75e0c44f90b8bd9f2fbabb7435/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:09.742029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860b89-5748-4835-8669-b761ad5436fe None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.742341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860b89-5748-4835-8669-b761ad5436fe None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.742628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39860b89-5748-4835-8669-b761ad5436fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.769028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-39860b89-5748-4835-8669-b761ad5436fe None None] MFA Rules not processed for user `e6bdec75e0c44f90b8bd9f2fbabb7435`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:09.770251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-39860b89-5748-4835-8669-b761ad5436fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:09.839101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1105/2161] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:09.843912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.913446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce12d6-6e51-4acb-aa3f-8540f1e72fb3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.918165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:09.918835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:09.919124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:09.919406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:09.920153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:09.922050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:09.941766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:09.952900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1057/2162] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:09.954137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860b89-5748-4835-8669-b761ad5436fe None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:09.966320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39860b89-5748-4835-8669-b761ad5436fe None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:09.974122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:10.034739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.035325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.035732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.036205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.036944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.039331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.060628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1106/2163] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:09 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:10.064586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:10.075711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dfce0-ea9f-44e1-8869-ff3e8bf4b525 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:10.082370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.083042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.083330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.083646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.085037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.086639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.098724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1058/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:10.103836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:10.116841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b764eb-81e2-4ed9-be3f-835f9056d823 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:10.122244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.123166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.123460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.123774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] PATH_INFO: `/v3/projects/4bf121df95ea4781bd4861591e92ecc3/users/d034c33c188d4ce2a9baba1a9bb14b2a/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.142617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf121df95ea4781bd4861591e92ecc3, user_id=d034c33c188d4ce2a9baba1a9bb14b2a, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.145371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.160751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1107/2165] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:10 2022] PUT /identity/v3/projects/4bf121df95ea4781bd4861591e92ecc3/users/d034c33c188d4ce2a9baba1a9bb14b2a/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:10.165448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:10.178182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada8b8-f513-4481-84d2-351813f269d0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:10.247198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.248146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.248588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.249063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.250111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.252565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268154d0-4ebf-4390-ae11-131ca9d01865 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.272837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1059/2166] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:10.277022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:10.293260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2b9a-85b0-4ea7-900d-b95ab786e352 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:10.298928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.299877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.300163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.300500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] PATH_INFO: `/v3/projects/4bf121df95ea4781bd4861591e92ecc3/users/d034c33c188d4ce2a9baba1a9bb14b2a/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.303859 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf121df95ea4781bd4861591e92ecc3, user_id=d034c33c188d4ce2a9baba1a9bb14b2a, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.307291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.329239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1108/2167] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:10 2022] PUT /identity/v3/projects/4bf121df95ea4781bd4861591e92ecc3/users/d034c33c188d4ce2a9baba1a9bb14b2a/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:10.348581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.348949 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.349329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.389642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] MFA Rules not processed for user `d034c33c188d4ce2a9baba1a9bb14b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:10.391281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:10.489487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1060/2168] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:10.501936 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:10.503868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:10.576244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fad81-4a79-4e9b-a978-278227444cd2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:10.581656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:10.582403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:10.582691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:10.582969 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:10.650462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:10.652087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:10.661810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1109/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:12.202577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:12.212222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d84d3-609a-4153-8e67-01ad4dfe5aca None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:12.216582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:12.217276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:12.217568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:12.217855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:12.276287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:12.277842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:12.287679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1061/2170] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:12.956066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:12.966102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94e4-4c8d-4e12-afb1-0d47f583e30e service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:12.969845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:12.970506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:12.970797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:12.971340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:12.985703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:12.987171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ca02-0014-4104-b74d-8043bd2aa3cf service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:12.997818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1110/2171] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:16.888330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:16.898466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:16.963821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7cc96-a2ee-462d-9ee5-94af5d6299ae service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:16.969724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:16.970614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:16.970898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:16.971198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] PATH_INFO: `/v3/users/221c0df45be144cfa9ef970a9e28b2cb` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:16.972434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221c0df45be144cfa9ef970a9e28b2cb)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:16.975646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:17.032800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221c0df45be144cfa9ef970a9e28b2cb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:17.040571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221c0df45be144cfa9ef970a9e28b2cb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:17.054012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221c0df45be144cfa9ef970a9e28b2cb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:17.054764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221c0df45be144cfa9ef970a9e28b2cb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:17.061510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221c0df45be144cfa9ef970a9e28b2cb'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:17.067555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1062/2172] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:16 2022] DELETE /identity/v3/users/221c0df45be144cfa9ef970a9e28b2cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:17.072120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:17.072607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:17.072709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:17.080451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:17.094784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:17.096388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:17.160032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1111/2173] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:17.170315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:17.173375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:17.238424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b2d7-5b12-4f48-8263-9f0527ca7201 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:17.243310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:17.243994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:17.244284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:17.244747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:17.255159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:17.257266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:17.267642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1063/2174] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:18.129482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:18.132715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:18.148718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020d9a-cf68-46e9-8a7c-69784cff391a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:18.154187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:18.155336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:18.155752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:18.156240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] PATH_INFO: `/v3/projects/5552d647baf648cdaf00a4edf2e1f938` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:18.158325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5552d647baf648cdaf00a4edf2e1f938)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:18.160867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:18.238345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5552d647baf648cdaf00a4edf2e1f938', 'request_id': 'req-3a254e77-25c1-43fc-bb3b-c006e2814d87'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.254078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5552d647baf648cdaf00a4edf2e1f938', 'request_id': 'req-3a254e77-25c1-43fc-bb3b-c006e2814d87'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.263199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5552d647baf648cdaf00a4edf2e1f938', 'request_id': 'req-3a254e77-25c1-43fc-bb3b-c006e2814d87'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.291035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] The token cache is being invalidate because project 5552d647baf648cdaf00a4edf2e1f938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:18.291954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.293319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.295112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1112/2175] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:18 2022] DELETE /identity/v3/projects/5552d647baf648cdaf00a4edf2e1f938 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:18.300426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:18.311350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8903f24-8562-4af2-bb36-3f55c2f91713 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:18.348537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:18.390644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:18.392146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:18.393032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:18.393336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] PATH_INFO: `/v3/users/e6bdec75e0c44f90b8bd9f2fbabb7435` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:18.395724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bdec75e0c44f90b8bd9f2fbabb7435)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:18.398482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:18.476953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bdec75e0c44f90b8bd9f2fbabb7435'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.485001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bdec75e0c44f90b8bd9f2fbabb7435'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.499728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bdec75e0c44f90b8bd9f2fbabb7435'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.500442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bdec75e0c44f90b8bd9f2fbabb7435'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.508318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bdec75e0c44f90b8bd9f2fbabb7435'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:18.514595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1064/2176] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:18 2022] DELETE /identity/v3/users/e6bdec75e0c44f90b8bd9f2fbabb7435 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:18.823013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:18.825015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:18.884394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a254e77-25c1-43fc-bb3b-c006e2814d87 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:19.016967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:19.021991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.022563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.023556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] PATH_INFO: `/v3/projects/3620d686879444cb9a1edae217b0d035` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.029108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3620d686879444cb9a1edae217b0d035)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:19.035791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:19.085564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:19.107509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3620d686879444cb9a1edae217b0d035', 'request_id': 'req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.116895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3620d686879444cb9a1edae217b0d035', 'request_id': 'req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.125218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3620d686879444cb9a1edae217b0d035', 'request_id': 'req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.142475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] The token cache is being invalidate because project 3620d686879444cb9a1edae217b0d035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:19.143422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.144077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.147148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1113/2177] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:18 2022] DELETE /identity/v3/projects/3620d686879444cb9a1edae217b0d035 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:19.151199 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:19.153264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:19.184359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241094-b23a-42c6-a7eb-f5e21cbf85ad admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:19.249921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:19.250809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.251100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.251379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] PATH_INFO: `/v3/users/d034c33c188d4ce2a9baba1a9bb14b2a` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.252719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d034c33c188d4ce2a9baba1a9bb14b2a)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:19.254650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:19.304562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd034c33c188d4ce2a9baba1a9bb14b2a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.308155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:19.312594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd034c33c188d4ce2a9baba1a9bb14b2a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.326169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd034c33c188d4ce2a9baba1a9bb14b2a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.326835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd034c33c188d4ce2a9baba1a9bb14b2a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.334311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-52bafff2-a531-4d93-a22b-dc555b8aea34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd034c33c188d4ce2a9baba1a9bb14b2a'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.340616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1065/2178] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:19 2022] DELETE /identity/v3/users/d034c33c188d4ce2a9baba1a9bb14b2a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:19.616500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:19.617982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:19.631623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfe5d2-98f8-493a-a556-72918ac7b1e3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:19.692739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:19.693514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.693800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.694077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] PATH_INFO: `/v3/projects/4bf121df95ea4781bd4861591e92ecc3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.695294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf121df95ea4781bd4861591e92ecc3)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:19.697223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:19.743795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf121df95ea4781bd4861591e92ecc3', 'request_id': 'req-8e2bbe27-7949-4994-a7da-df58a8323636'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.751136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf121df95ea4781bd4861591e92ecc3', 'request_id': 'req-8e2bbe27-7949-4994-a7da-df58a8323636'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.757721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf121df95ea4781bd4861591e92ecc3', 'request_id': 'req-8e2bbe27-7949-4994-a7da-df58a8323636'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.772957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] The token cache is being invalidate because project 4bf121df95ea4781bd4861591e92ecc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:19.773251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.773945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8e2bbe27-7949-4994-a7da-df58a8323636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:19.775614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1114/2179] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:19 2022] DELETE /identity/v3/projects/4bf121df95ea4781bd4861591e92ecc3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:19.780662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.780961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.781249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.800680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:19.801904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:19.861307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1066/2180] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:19.872106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.872400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.872686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.890870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:19.892173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:19.900736 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1115/2181] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:19.905095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:19.915545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a967e5a-825e-4706-8e21-c0eecd55db7e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:19.920229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:19.920891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.921178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.921486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.922224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:19.922534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:19.924181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:19.936196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1067/2182] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:19.940566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:19.950028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ea0af-45f4-44d1-bac1-5071facdf82f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:19.954730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:19.955380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:19.955698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:19.955978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:19.956676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:19.958584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:19.984977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1116/2183] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:19 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:19.989132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:19.999764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c538a-95e3-41ed-b6e5-1a7be5e41e9e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:20.065122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:20.065862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.066160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.066446 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.067158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:20.069798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:20.093094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1068/2184] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:19 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:20.108601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:20.120845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74809c62-1cf5-49c8-b468-9cfde776a997 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:20.136980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:20.138072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.138464 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.138885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.139855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:20.142015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:20.156989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1117/2185] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:20.162844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:20.176312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b4d1-02b7-4d0c-8a2a-cdfe37ed1659 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:20.182535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:20.183239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.183753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.184048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.184946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:20.186603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ea3c5-eb95-4c41-8e89-031dee0e6b3e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:20.206186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1069/2186] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:20.210418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:20.225674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7c0f-7fd3-4a18-a2f3-9843779a1628 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:20.231185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:20.232134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.232426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.232707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] PATH_INFO: `/v3/projects/c13730922f3845b6a8b5b9daa3f12d29/users/84eae7417ed643b78fd1fbd5d6f47c88/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.236459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:20.255899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13730922f3845b6a8b5b9daa3f12d29, user_id=84eae7417ed643b78fd1fbd5d6f47c88, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:20.258615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:20.283799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1118/2187] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:20 2022] PUT /identity/v3/projects/c13730922f3845b6a8b5b9daa3f12d29/users/84eae7417ed643b78fd1fbd5d6f47c88/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:20.294902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcf75-50ab-40b0-9f3d-5efb3e3ba408 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.295484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcf75-50ab-40b0-9f3d-5efb3e3ba408 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.295986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfcf75-50ab-40b0-9f3d-5efb3e3ba408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.341803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5acfcf75-50ab-40b0-9f3d-5efb3e3ba408 None None] MFA Rules not processed for user `84eae7417ed643b78fd1fbd5d6f47c88`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:20.343982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5acfcf75-50ab-40b0-9f3d-5efb3e3ba408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:20.373363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:20.464381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1070/2188] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:20.502407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:20.504205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:20.577341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983fa4f-050b-4593-8824-32a8b0bee1ed admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:20.581200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:20.582018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:20.582297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:20.582574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:20.601263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:20.602723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:20.612153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1119/2189] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:22.145798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500060a-b77d-45fe-b9be-2dab678263f2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:22.147127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500060a-b77d-45fe-b9be-2dab678263f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:22.147127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500060a-b77d-45fe-b9be-2dab678263f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:22.165091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f500060a-b77d-45fe-b9be-2dab678263f2 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:22.166271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f500060a-b77d-45fe-b9be-2dab678263f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:22.253276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1071/2190] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:22.309862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:22.311338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:22.389728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca6e2c-ee9a-44b6-8cd0-34e3c31db5b5 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:22.395882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:22.396715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:22.397313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:22.397681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:22.406439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:22.408110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:22.416371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1120/2191] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:50:27.272232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe7cd-0478-4ee4-8e5d-7a3832ce63f9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:27.273582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe7cd-0478-4ee4-8e5d-7a3832ce63f9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:27.273582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe7cd-0478-4ee4-8e5d-7a3832ce63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:27.313976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ca9fe7cd-0478-4ee4-8e5d-7a3832ce63f9 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:27.317122 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ca9fe7cd-0478-4ee4-8e5d-7a3832ce63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:27.330385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1072/2192] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:27.359106 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:27.372862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e3f5-74c7-4a22-bf47-b9f96852519a service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:27.380716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:27.382160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:27.382627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:27.383378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:27.425937 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:27.431764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:27.468978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1121/2193] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:50:28.662146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d61e3-83c7-4482-830d-949f8c79cb54 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:28.663148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d61e3-83c7-4482-830d-949f8c79cb54 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:28.663778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d61e3-83c7-4482-830d-949f8c79cb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:28.689715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-9b0d61e3-83c7-4482-830d-949f8c79cb54 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:28.691068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9b0d61e3-83c7-4482-830d-949f8c79cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:28.704906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1073/2194] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:28.713243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:28.726865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b8ea4-3717-41da-8eb4-88d9d2dd389b service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:28.733553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:28.734215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:28.734699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:28.735157 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:28.745705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:28.747380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:28.773731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1122/2195] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:50:29.055283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0113-934a-4b71-bd8c-74a1d14379d4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:29.055691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0113-934a-4b71-bd8c-74a1d14379d4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:29.055923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0113-934a-4b71-bd8c-74a1d14379d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:29.077739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-60cb0113-934a-4b71-bd8c-74a1d14379d4 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:29.079057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-60cb0113-934a-4b71-bd8c-74a1d14379d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:29.087526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1074/2196] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:29.102359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:29.116778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178507-53cd-4207-86dd-b1356ad75da2 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:29.122814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:29.123632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:29.124167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:29.124517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:29.135707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:29.137592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:29.147290 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1123/2197] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:50:29.749025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:29.749610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:29.749935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:29.773491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:29.774767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:29.782548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1075/2198] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:29.803550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:29.814354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850557d-e682-4438-ab4f-3f0e46ed8c83 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:29.820708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:29.821659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:29.822224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:29.822689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:29.835207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:29.838080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:29.849477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1124/2199] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:50:32.285186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:32.287910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:32.440632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07b00f-926f-4010-bd32-f4f051fcb3d3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:32.446077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:32.447715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:32.448302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:32.448748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] PATH_INFO: `/v3/users/f6652a5e3703476a9521dce4cb746cab` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:32.450629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6652a5e3703476a9521dce4cb746cab)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:32.453824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:32.572453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:32.574639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:32.592937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6652a5e3703476a9521dce4cb746cab'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.601147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:32.603598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb344ef-3a2b-4c90-b0e6-1670495b3982 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:32.609076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6652a5e3703476a9521dce4cb746cab'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.638341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6652a5e3703476a9521dce4cb746cab'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.639749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6652a5e3703476a9521dce4cb746cab'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.640119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:32.641019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:32.641329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:32.641608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] PATH_INFO: `/v3/users/113a056d964347468584ffadb2d73686` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:32.645257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113a056d964347468584ffadb2d73686)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:32.652527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:32.663242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-4806dddd-8011-48be-af87-4010bba8a502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6652a5e3703476a9521dce4cb746cab'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.674618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1076/2200] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:32 2022] DELETE /identity/v3/users/f6652a5e3703476a9521dce4cb746cab => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:32.679576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:32.680225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:32.680824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:32.719306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:32.727702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:32.730868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:32.798710 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113a056d964347468584ffadb2d73686'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.831361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113a056d964347468584ffadb2d73686'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.865590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113a056d964347468584ffadb2d73686'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.875616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1077/2201] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:32.875847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113a056d964347468584ffadb2d73686'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.875847 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2fd087ed-c474-435f-a5fc-a8673a8a76a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113a056d964347468584ffadb2d73686'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:32.883139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:32.884649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:32.887559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1125/2202] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:32 2022] DELETE /identity/v3/users/113a056d964347468584ffadb2d73686 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:32.893338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:32.894032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:32.895110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:32.919004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:32.920678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:32.982155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499c24-0b32-4689-a0aa-73e9bfb8e44e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.015965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1126/2203] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:33.017524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:33.019148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.035734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d85c-86be-434e-80dc-d6206cbfd67d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.045794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.046892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.047293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.047714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] PATH_INFO: `/v3/users/84eae7417ed643b78fd1fbd5d6f47c88` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.049095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=84eae7417ed643b78fd1fbd5d6f47c88)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.051442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.064367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.065304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.065626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.066039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.072169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.088544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.090629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.107276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1078/2204] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:50:33.108812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:33.110511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.125705 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801df4e-1ea8-4542-bdb0-29798c697ff2 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.134517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.135537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.135827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.136113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.153422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.154900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b5154-dbc9-44c8-81e1-9b06af1252e3 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.156916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84eae7417ed643b78fd1fbd5d6f47c88'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.170059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1079/2205] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:33.176444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84eae7417ed643b78fd1fbd5d6f47c88'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.205284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84eae7417ed643b78fd1fbd5d6f47c88'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.215674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84eae7417ed643b78fd1fbd5d6f47c88'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.219914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84eae7417ed643b78fd1fbd5d6f47c88'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.240509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1127/2206] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:33 2022] DELETE /identity/v3/users/84eae7417ed643b78fd1fbd5d6f47c88 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:33.246516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.246938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.248468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.280040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:33.281901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.289912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:33.367793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1080/2207] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:33.378162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:33.380424 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.396004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:33.485609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:33.487641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.517352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111dd7d-06b9-43f7-81d9-0f1d0ac2815e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.530308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.531380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.531790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.532162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] PATH_INFO: `/v3/projects/f89d2c26ed6444e3a6992842e8b2c30f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.533531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89d2c26ed6444e3a6992842e8b2c30f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.536744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.572456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40d9a3-2809-4b3e-a89b-fe8bd9d477ff admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.577196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.577866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.578153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.578436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.592073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.593856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.611651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1128/2208] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:33.633073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89d2c26ed6444e3a6992842e8b2c30f', 'request_id': 'req-dd401733-746b-44de-bb39-267a90fb13a7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.656324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:33.660716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:33.661054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89d2c26ed6444e3a6992842e8b2c30f', 'request_id': 'req-dd401733-746b-44de-bb39-267a90fb13a7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.685163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89d2c26ed6444e3a6992842e8b2c30f', 'request_id': 'req-dd401733-746b-44de-bb39-267a90fb13a7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.700520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be5a6-51f9-4f44-bd1f-b2c3f305e924 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:33.734818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] The token cache is being invalidate because project f89d2c26ed6444e3a6992842e8b2c30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:33.736698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.738866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dd401733-746b-44de-bb39-267a90fb13a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.742415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1081/2209] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:33 2022] DELETE /identity/v3/projects/f89d2c26ed6444e3a6992842e8b2c30f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:33.786655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:33.788367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:33.788867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:33.789336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] PATH_INFO: `/v3/projects/288f83165665447d9a1300c145b4f4e9` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:33.790996 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=288f83165665447d9a1300c145b4f4e9)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:33.793237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:33.960442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288f83165665447d9a1300c145b4f4e9', 'request_id': 'req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.979093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288f83165665447d9a1300c145b4f4e9', 'request_id': 'req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:33.989975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288f83165665447d9a1300c145b4f4e9', 'request_id': 'req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.004099 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] The token cache is being invalidate because project 288f83165665447d9a1300c145b4f4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:34.004451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.006110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7aa33b57-6404-49cc-b9b4-f2c5ef24e02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.011234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1129/2210] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:33 2022] DELETE /identity/v3/projects/288f83165665447d9a1300c145b4f4e9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:34.016648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.017114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.017236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.052527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:34.054360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:34.134896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1082/2211] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:34.143619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.143907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.144101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.199104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:34.200972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:34.201316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.203971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:34.229166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c677c-4f56-4109-a1d9-88817e5b928f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.246235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.247153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.247437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.248311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] PATH_INFO: `/v3/projects/c13730922f3845b6a8b5b9daa3f12d29` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.249613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13730922f3845b6a8b5b9daa3f12d29)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.253088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.273613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1130/2212] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:34.274609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.287697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c05e-05c9-4da1-9108-271493f7b4f8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.294375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.295243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.295571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.295906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.296692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:34.297050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.298860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.313622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:34.325675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1131/2213] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:34.327818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.348075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38048d5-8ec3-45a9-88d1-11424c7fbf6e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.358058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13730922f3845b6a8b5b9daa3f12d29', 'request_id': 'req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.381903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13730922f3845b6a8b5b9daa3f12d29', 'request_id': 'req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.396062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13730922f3845b6a8b5b9daa3f12d29', 'request_id': 'req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.402778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:34.431153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] The token cache is being invalidate because project c13730922f3845b6a8b5b9daa3f12d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:34.431579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.433313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:34.452523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1083/2214] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:34 2022] DELETE /identity/v3/projects/c13730922f3845b6a8b5b9daa3f12d29 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:34.557147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.558254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.559496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.559496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.561556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.564742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.663827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1132/2215] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:34 2022] POST /identity/v3/projects => generated 381 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:34.686041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.696964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:34.760133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f2d75-b0ac-4572-bb6c-bcb64855ac70 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.837826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.838680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.838988 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.839316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.840290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.842951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.875155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1084/2216] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:34 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:50:34.880890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.892914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f72301-36ec-4b12-88b1-832837ac9de7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.907629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.908563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.909154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.909770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.910714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.913459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.931846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1133/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:34.933141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.944491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2599-0bf6-4393-8ae0-e9bc3314a9cd admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.950374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.951568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.951568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:34.951790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:34.952745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:34.954464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77536765-dd22-4a99-8ce2-132975c60f97 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:34.966617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1085/2218] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:34.971121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:34.987497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c58c1-c574-49d1-9e86-1db2d1ae580e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:34.995150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:34.999489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:34.999798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:35.000079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] PATH_INFO: `/v3/projects/8bf38006ccd94f05bf78186f2dbec022/users/bf26b8412da548bd98a461445b3bd09c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:35.033514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf38006ccd94f05bf78186f2dbec022, user_id=bf26b8412da548bd98a461445b3bd09c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:35.036326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:35.053905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1134/2219] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:34 2022] PUT /identity/v3/projects/8bf38006ccd94f05bf78186f2dbec022/users/bf26b8412da548bd98a461445b3bd09c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:35.059021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fe4b-71f1-4b96-aba6-4e6e51ba5720 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:35.059322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fe4b-71f1-4b96-aba6-4e6e51ba5720 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:35.059708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721fe4b-71f1-4b96-aba6-4e6e51ba5720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:35.080083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6721fe4b-71f1-4b96-aba6-4e6e51ba5720 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:35.081313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6721fe4b-71f1-4b96-aba6-4e6e51ba5720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:35.157292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1086/2220] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:35.172627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:35.177892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:35.269617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065955-8f53-40de-9c1d-c926acec9b50 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:35.274786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:35.275546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:35.275895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:35.276240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:35.295534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:35.295534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:35.316038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1135/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:36.658402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0c3b-3811-4962-aef7-3195e2301aff None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:36.659216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0c3b-3811-4962-aef7-3195e2301aff None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:36.659216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0c3b-3811-4962-aef7-3195e2301aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:36.720317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f1fa0c3b-3811-4962-aef7-3195e2301aff None None] MFA Rules not processed for user `bf26b8412da548bd98a461445b3bd09c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:36.721845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f1fa0c3b-3811-4962-aef7-3195e2301aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:36.763159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:36.851964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1087/2222] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:36.862457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:36.864062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:36.948915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d845c3-cf6b-4275-890a-060314655a38 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:36.953788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:36.954462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:36.954754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:36.955044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:36.971084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:36.972922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:36.986432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1136/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:38.511650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c769-5a85-4c2e-89d1-a2ed392126d2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:38.511650 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c769-5a85-4c2e-89d1-a2ed392126d2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:38.512503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c769-5a85-4c2e-89d1-a2ed392126d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:38.551720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-67c5c769-5a85-4c2e-89d1-a2ed392126d2 None None] MFA Rules not processed for user `bf26b8412da548bd98a461445b3bd09c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:38.553091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-67c5c769-5a85-4c2e-89d1-a2ed392126d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:38.562611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1088/2224] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:40.922988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:40.924524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:40.953323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a2956-098c-4042-a9bc-7f1a033e4225 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:40.959525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:40.960698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:40.961297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:40.961850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] PATH_INFO: `/v3/users/9f1bccc61e0d461899f34564d1985b4c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:40.963625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1bccc61e0d461899f34564d1985b4c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:40.966961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:40.989081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:41.069169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1bccc61e0d461899f34564d1985b4c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:41.082177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1bccc61e0d461899f34564d1985b4c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:41.100708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1bccc61e0d461899f34564d1985b4c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:41.119396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1bccc61e0d461899f34564d1985b4c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:41.120268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1bccc61e0d461899f34564d1985b4c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:41.133180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1137/2225] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:40 2022] DELETE /identity/v3/users/9f1bccc61e0d461899f34564d1985b4c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:41.134941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:41.135400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:41.135688 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:41.161708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:41.163361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:41.263051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1089/2226] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:41.279149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:41.280834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:41.384293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e2ba-9425-4f75-8637-a3480f67e8e3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:41.395241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:41.396147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:41.397101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:41.397515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:41.412656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:41.415516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:41.434243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1138/2227] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:42.333216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:42.336053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:42.351421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d1b7a-a023-4158-adef-611cf30883c1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:42.357143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:42.358595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:42.359142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:42.359687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] PATH_INFO: `/v3/projects/a540fb590db24c679c910913522d8bb2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:42.361751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a540fb590db24c679c910913522d8bb2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:42.364284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:42.448251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a540fb590db24c679c910913522d8bb2', 'request_id': 'req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.460719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a540fb590db24c679c910913522d8bb2', 'request_id': 'req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.487749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a540fb590db24c679c910913522d8bb2', 'request_id': 'req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.515251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] The token cache is being invalidate because project a540fb590db24c679c910913522d8bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:42.515591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.521461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b0788c62-0b0d-417a-b37a-3ad1a61fd2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.523436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1090/2228] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:42 2022] DELETE /identity/v3/projects/a540fb590db24c679c910913522d8bb2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:42.534501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:42.550543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d6e9-05a5-4071-85cd-c9cf4bca1de9 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:42.700360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:42.700615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:42.700834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:42.701078 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] PATH_INFO: `/v3/users/f0d938d66c584191a1d63461398a7ffc` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:42.705915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d938d66c584191a1d63461398a7ffc)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:42.707983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:42.792723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:42.830135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d938d66c584191a1d63461398a7ffc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.874207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d938d66c584191a1d63461398a7ffc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.893852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78255-e69a-49ea-af21-53cd28c35c4c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:42.894152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78255-e69a-49ea-af21-53cd28c35c4c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:42.894435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78255-e69a-49ea-af21-53cd28c35c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:42.902576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d938d66c584191a1d63461398a7ffc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.918036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d938d66c584191a1d63461398a7ffc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.919343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d938d66c584191a1d63461398a7ffc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:42.928299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1139/2229] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:42 2022] DELETE /identity/v3/users/f0d938d66c584191a1d63461398a7ffc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:42.932445 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-46b78255-e69a-49ea-af21-53cd28c35c4c None None] MFA Rules not processed for user `b917fb517461496885f5c5dfb6a0b207`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:42.933751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-46b78255-e69a-49ea-af21-53cd28c35c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:43.021309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:43.066127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1091/2230] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:43.406531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:43.408102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:43.558052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a66b-3fd3-47ef-80e7-129ef55cabdd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:43.563316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:43.564315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:43.564693 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:43.565056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] PATH_INFO: `/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:43.566641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c5bf76fec545f7bb53001fbeb91b23)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:43.568795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:43.637678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c5bf76fec545f7bb53001fbeb91b23', 'request_id': 'req-5d74ea6f-7d8a-437a-913b-ccda161df8ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:43.658027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c5bf76fec545f7bb53001fbeb91b23', 'request_id': 'req-5d74ea6f-7d8a-437a-913b-ccda161df8ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:43.684154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c5bf76fec545f7bb53001fbeb91b23', 'request_id': 'req-5d74ea6f-7d8a-437a-913b-ccda161df8ae'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:43.713825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] The token cache is being invalidate because project b6c5bf76fec545f7bb53001fbeb91b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:43.714174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:43.719000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5d74ea6f-7d8a-437a-913b-ccda161df8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:43.719000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1140/2231] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:43 2022] DELETE /identity/v3/projects/b6c5bf76fec545f7bb53001fbeb91b23 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:43.723093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:43.724408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:43.724408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:43.760538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:43.762125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:43.849906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1092/2232] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:43.852607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:43.853165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:43.853803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:43.877069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:43.878516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:43.887363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1141/2233] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:43.892754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:43.904579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b7e7-e8db-447e-8c62-6aabaeccac68 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:43.909911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:43.910746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:43.911704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:43.912056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:43.912995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:43.913390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:43.916392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:43.934844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1093/2234] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:43.935944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:43.947060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0676-edfb-455c-9b7f-dda9803c1c25 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:43.966886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:43.967593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:43.967876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:43.968148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:43.968948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:43.971119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.013716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.014928 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1142/2235] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:44.028644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55efd6-a75b-4a7f-848f-bba1a5c1c47b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.115074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.115904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.116272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.116620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.117395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.119490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.144849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1094/2236] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:44.148868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.161818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1986-5791-4280-9fa5-07a1beb92e9a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.166627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.167321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.167622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.167903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.168646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.170403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.183519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1143/2237] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:44.187635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.198683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669a11-71ed-4cdb-87a8-394c03768e98 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.204695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.205439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.205884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.206170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.206907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.208565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e20a-1bb3-4765-a5a1-4ba19cbc7fdb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.218966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1095/2238] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:44.223251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.228492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:44.235438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d8c5-5df8-4838-90a1-bd8edbf9d46f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.242906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.243853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.244133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.245185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] PATH_INFO: `/v3/projects/47902ac9a0fd40f3afef4955515bb779/users/9397bbd6cbb6458ea551942de6a46f8c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.262816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47902ac9a0fd40f3afef4955515bb779, user_id=9397bbd6cbb6458ea551942de6a46f8c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.265749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.279643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1144/2239] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:44 2022] PUT /identity/v3/projects/47902ac9a0fd40f3afef4955515bb779/users/9397bbd6cbb6458ea551942de6a46f8c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:44.290755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.291047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.291328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.323795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] MFA Rules not processed for user `9397bbd6cbb6458ea551942de6a46f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:44.325054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:44.370490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:44.399257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1096/2240] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:44.404120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.465991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac513c-15cc-48e6-82c3-eae8acbeab20 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.470660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.471321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.471648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.471935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.472640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.475079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.500849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1145/2241] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:44.504961 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.515664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176bf4d-0849-406e-91c3-adca264b168e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.574466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.575157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.575442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.575752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.576455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.578374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.600581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1097/2242] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:44.604116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.615775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791fa8c-0d25-4752-99ca-d2d8090b9425 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.620764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.621420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.621776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.621989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.622741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.624383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.636785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1146/2243] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:44.641019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.651749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf7c05-9ae5-490f-8971-893ee26576ec admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.656531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.657432 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.657737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.658109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] PATH_INFO: `/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db/users/4a90b9f12fe74f1a8bb2104778eafefa/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.674304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaceaed4aaa247d3ae4bf9743ffe36db, user_id=4a90b9f12fe74f1a8bb2104778eafefa, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.677599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678db35-caf7-4319-b3c6-f60979f6b3b2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.696573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1098/2244] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:44 2022] PUT /identity/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db/users/4a90b9f12fe74f1a8bb2104778eafefa/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:44.710760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.730926 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2093d1-ec6f-4d69-99f8-83d75a8afc22 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.744331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.744835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.745425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.775363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:44.776645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:44.810724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.811524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.812051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.812750 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.813359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.815063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.826284 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1147/2245] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:44.830830 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.842021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1099/2246] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:44.844382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823444-2f10-4a0d-8ac0-3a247b25f041 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.852279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.853183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.853665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.853979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] PATH_INFO: `/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db/users/4a90b9f12fe74f1a8bb2104778eafefa/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.854854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.856039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaceaed4aaa247d3ae4bf9743ffe36db, user_id=4a90b9f12fe74f1a8bb2104778eafefa, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:44.856287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:44.858716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc1d99-6a9b-4013-8a42-607d87cb4272 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:44.871543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1148/2247] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:44 2022] PUT /identity/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db/users/4a90b9f12fe74f1a8bb2104778eafefa/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:44.882194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.882490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.882778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.911347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] MFA Rules not processed for user `4a90b9f12fe74f1a8bb2104778eafefa`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:44.912614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:44.915128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:44.934701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdfa73-1c4f-4c60-96e0-94c4b4eaf1f2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:44.937845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:44.985813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1149/2248] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:44.996089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:44.996822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:44.997110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:44.997387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:44.997713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:44.999168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:45.057374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:45.058074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf146-51c4-483f-8740-9263ebd03f57 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:45.059002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:45.061950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:45.062605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:45.062895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:45.063175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:45.069063 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1100/2249] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 14:50:45.073972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:45.075500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ff85-f310-4781-819f-1ce9ea90bd15 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:45.085590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1150/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:50:45.504348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:45.578967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852a4d-a1d1-4bfd-921e-9a0e7c1da94b service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:45.584400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:45.585356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:45.585759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:45.586045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] PATH_INFO: `/v3/users/9397bbd6cbb6458ea551942de6a46f8c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:45.587283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9397bbd6cbb6458ea551942de6a46f8c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:45.589333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:45.632628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:45.639555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9397bbd6cbb6458ea551942de6a46f8c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:45.647194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9397bbd6cbb6458ea551942de6a46f8c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:45.659347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9397bbd6cbb6458ea551942de6a46f8c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:45.660119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9397bbd6cbb6458ea551942de6a46f8c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:45.667110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9397bbd6cbb6458ea551942de6a46f8c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:45.675530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1101/2251] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:45 2022] DELETE /identity/v3/users/9397bbd6cbb6458ea551942de6a46f8c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:45.678301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:45.678734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:45.678920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:45.698421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:45.699676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:45.761695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1151/2252] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:45.771725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:45.773129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:45.829589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81655693-fa50-416d-88e2-f61a2d5b0e26 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:45.834192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:45.834822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:45.835101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:45.835377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:45.844889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:45.848043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:45.857911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1102/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:46.219412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:46.220929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:46.235179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09037f-c4af-43e8-8b98-7d902907df67 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:46.254247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:46.255226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:46.255522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:46.255826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] PATH_INFO: `/v3/projects/47902ac9a0fd40f3afef4955515bb779` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:46.257221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47902ac9a0fd40f3afef4955515bb779)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:46.259164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:46.312844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47902ac9a0fd40f3afef4955515bb779', 'request_id': 'req-c0959cc1-ac9d-4818-aed7-25a366e0c22f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.320246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47902ac9a0fd40f3afef4955515bb779', 'request_id': 'req-c0959cc1-ac9d-4818-aed7-25a366e0c22f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.322245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:46.326730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47902ac9a0fd40f3afef4955515bb779', 'request_id': 'req-c0959cc1-ac9d-4818-aed7-25a366e0c22f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.339176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] The token cache is being invalidate because project 47902ac9a0fd40f3afef4955515bb779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:46.339490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.340149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.342092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1152/2254] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:46 2022] DELETE /identity/v3/projects/47902ac9a0fd40f3afef4955515bb779 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:46.346062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:46.356398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc63-3919-4f6a-90cc-3ce20f5e7113 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:46.413407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:46.414282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:46.414570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:46.414854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] PATH_INFO: `/v3/users/4a90b9f12fe74f1a8bb2104778eafefa` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:46.416083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a90b9f12fe74f1a8bb2104778eafefa)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:46.418014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:46.463524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a90b9f12fe74f1a8bb2104778eafefa'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.471801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a90b9f12fe74f1a8bb2104778eafefa'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.478072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:46.487126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a90b9f12fe74f1a8bb2104778eafefa'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.488029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a90b9f12fe74f1a8bb2104778eafefa'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.494926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a90b9f12fe74f1a8bb2104778eafefa'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:46.501600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1103/2255] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:46 2022] DELETE /identity/v3/users/4a90b9f12fe74f1a8bb2104778eafefa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:47.171993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.176234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.196592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959cc1-ac9d-4818-aed7-25a366e0c22f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.377990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.378879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.379198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.379971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] PATH_INFO: `/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.381378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaceaed4aaa247d3ae4bf9743ffe36db)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.384155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.426049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.428184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.448893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715095d-114c-4535-963b-b7a530f9318a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.492259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaceaed4aaa247d3ae4bf9743ffe36db', 'request_id': 'req-fd7ba36c-e16c-4b90-a275-2365a505aff6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.501881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaceaed4aaa247d3ae4bf9743ffe36db', 'request_id': 'req-fd7ba36c-e16c-4b90-a275-2365a505aff6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.510090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaceaed4aaa247d3ae4bf9743ffe36db', 'request_id': 'req-fd7ba36c-e16c-4b90-a275-2365a505aff6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.524658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] The token cache is being invalidate because project aaceaed4aaa247d3ae4bf9743ffe36db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:47.525207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.526046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fd7ba36c-e16c-4b90-a275-2365a505aff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.531864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1153/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:47 2022] DELETE /identity/v3/projects/aaceaed4aaa247d3ae4bf9743ffe36db => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:47.533688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a90f0-c4bc-4b90-9a43-395acb30b478 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.534151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a90f0-c4bc-4b90-9a43-395acb30b478 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.534605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a90f0-c4bc-4b90-9a43-395acb30b478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.550686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.552360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.552852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.553730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] PATH_INFO: `/v3/users/2d2dc55bafa84e5db4cf4774819ea136` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.555134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2dc55bafa84e5db4cf4774819ea136)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.558170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.558311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5b4a90f0-c4bc-4b90-9a43-395acb30b478 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:47.559739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5b4a90f0-c4bc-4b90-9a43-395acb30b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.570022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1154/2257] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:47.578224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.578573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.578860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.598161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:47.599927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.609433 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1155/2258] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:47.613150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.622753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2dc55bafa84e5db4cf4774819ea136'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.623062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a523b-d6c8-42ce-a881-5330c44a52e9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.628279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.628976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.629236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.630152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.630891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:47.631209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.632985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.633759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2dc55bafa84e5db4cf4774819ea136'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.649043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1156/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:47.654166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.655639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2dc55bafa84e5db4cf4774819ea136'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.656463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2dc55bafa84e5db4cf4774819ea136'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.665691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2dc55bafa84e5db4cf4774819ea136'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:47.667589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe5f6-9e8c-48ea-9a7f-d64335a2f419 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.672788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1104/2260] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:47 2022] DELETE /identity/v3/users/2d2dc55bafa84e5db4cf4774819ea136 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:47.674310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.675653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.676025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.676506 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.677553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.679814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.718318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1157/2261] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:47 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:47.719671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.721237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.800260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:47.806005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316bec5-e2f5-4921-ada9-032c834a842b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.905114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.905908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.906353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.906846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.908317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.913587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.921523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.924287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:47.946822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9806c-f5be-4914-8d69-1fe1a1caa50b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.956848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.959436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.960313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.961221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] PATH_INFO: `/v3/projects/7b90fc230da9420d95e5562935b5567f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.963558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1105/2262] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:47 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:47.968121 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b90fc230da9420d95e5562935b5567f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.970509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:47.972698 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:47.983164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc1d5-16df-4756-b1a0-3f956efd25e2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:47.990031 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:47.991113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:47.991113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:47.991333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:47.992290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:47.993904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.004989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1106/2263] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:48.009000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.011900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:48.019964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2fc1-7d47-44ae-992e-3178b3ed8e18 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.026753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.027664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.027943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.028397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.029150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.030889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.045236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1107/2264] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:48.049388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.050358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b90fc230da9420d95e5562935b5567f', 'request_id': 'req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:48.058654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b90fc230da9420d95e5562935b5567f', 'request_id': 'req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:48.062016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e568c15-610a-494b-9a35-9ef72c978a01 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.066773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b90fc230da9420d95e5562935b5567f', 'request_id': 'req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:48.083440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] The token cache is being invalidate because project 7b90fc230da9420d95e5562935b5567f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:48.083749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:48.084778 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9f7643ad-a2f5-4993-9e19-0a2cff1ac53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:48.087712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1158/2265] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:47 2022] DELETE /identity/v3/projects/7b90fc230da9420d95e5562935b5567f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:48.093539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9c69-7521-43e0-b2b7-603703cee9af None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.093829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9c69-7521-43e0-b2b7-603703cee9af None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.094113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d9c69-7521-43e0-b2b7-603703cee9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.117197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-508d9c69-7521-43e0-b2b7-603703cee9af None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:48.118580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-508d9c69-7521-43e0-b2b7-603703cee9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:48.135128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.137095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.137742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.138132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] PATH_INFO: `/v3/projects/0079a5ac96e74b41b4ec61c664f772e0/users/ccc3ba0eaec64c18a0677c3623d968ba/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.160626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0079a5ac96e74b41b4ec61c664f772e0, user_id=ccc3ba0eaec64c18a0677c3623d968ba, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.174221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95af3e-3c12-4ba6-89a0-ee389e85c167 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.193826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1159/2266] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:48.196115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1108/2267] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:48 2022] PUT /identity/v3/projects/0079a5ac96e74b41b4ec61c664f772e0/users/ccc3ba0eaec64c18a0677c3623d968ba/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:48.201373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.201824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.202241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.207491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.208473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.208828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.228056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:48.229711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:48.245176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] MFA Rules not processed for user `ccc3ba0eaec64c18a0677c3623d968ba`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:48.246764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:48.322192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:48.358193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1109/2268] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:48.362603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.367062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:48.375583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1160/2269] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:48.382044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.395070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075d83-d84e-400e-a310-718cbc6ac1f4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.396866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c255b28-9322-4a33-94ec-9b5e9c4f5acc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.401627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.402553 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.402936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.403305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.404161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.405308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.406175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.406518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.406791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.407221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.408160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:48.408648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.410604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.432439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1161/2270] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:48.434082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.450227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1110/2271] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:48.450815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.451984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed57d10-ff01-4393-a061-cf0a3802d9f7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.500310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:48.529368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.530337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.530775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.531363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.532452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.535342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.573201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1162/2272] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:48.577613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.601941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19090ad8-4e2a-431a-b3d5-921035ba544f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.678698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.679467 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.679944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.680231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.681315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.683693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.698867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926bcf8-5640-43ac-b62a-50398d3efbaa admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.711667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1111/2273] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:48.713144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.714199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.714498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.714782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.715787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.717334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.717760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.743671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b3089-20fb-4495-958d-b85e75589088 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.749536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.750275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.750565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.750902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.751669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.753808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.763634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1163/2274] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:48.764582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.769621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1112/2275] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:48.770649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.784523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4b65-6333-459c-b64d-1fd7ca223819 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.788676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a7485-595a-498d-8981-fb083f4320f2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.789982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.790707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.791130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.791422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.792222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.793925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.794774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.796912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.796912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.796912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.797914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.799788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.808197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1164/2276] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:48.812164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.812702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1113/2277] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:48.817672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.828494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e506-aaf1-4127-ad64-de138b564d69 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.828722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552672-c2ea-4908-8adb-6d6f819cc90e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.834202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.834364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.835130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.835270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.835590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.835700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.835878 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] PATH_INFO: `/v3/projects/dae4f6c2fcba4380b94dcadf18135c21/users/7d61faa14b014fd0bac0846f7168b593/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.836050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.836934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.838651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.852568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1165/2278] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:48.857002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:48.857146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae4f6c2fcba4380b94dcadf18135c21, user_id=7d61faa14b014fd0bac0846f7168b593, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.859872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844e114-59ad-4efa-863b-de3cddd5e53d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.869046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8a88-5032-496b-a602-e43d02a4d971 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:48.877916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:48.878821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.879112 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.880355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] PATH_INFO: `/v3/projects/b1aa01150eb445719e16c4a886175bbc/users/5c7ada3d45b643888e032bde5849e760/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.881636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1114/2279] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:48 2022] PUT /identity/v3/projects/dae4f6c2fcba4380b94dcadf18135c21/users/7d61faa14b014fd0bac0846f7168b593/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:48.891967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.892254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.892545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.914756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aa01150eb445719e16c4a886175bbc, user_id=5c7ada3d45b643888e032bde5849e760, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:48.919252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1403-b3c2-4a46-b7f7-5846a284f85b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:48.922555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:48.927064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] MFA Rules not processed for user `7d61faa14b014fd0bac0846f7168b593`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:48.931520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:48.950675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1166/2280] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:48 2022] PUT /identity/v3/projects/b1aa01150eb445719e16c4a886175bbc/users/5c7ada3d45b643888e032bde5849e760/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:48.952856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:48.953252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:48.953636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:48.997391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] MFA Rules not processed for user `5c7ada3d45b643888e032bde5849e760`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:48.998749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:49.033531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1115/2281] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:50:49.038478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.077309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:49.084872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1167/2282] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:49.098724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.100273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:49.172287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996a09-73a5-4731-b8b7-f369bf4a30f4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.179603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.181227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.181747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.182716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.183796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.186218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.194058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9a78-09fb-4371-a2ad-1642ff91e989 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.198796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.199707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.200007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.200294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.213339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.214854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.229136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1168/2283] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:49.230478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1116/2284] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:49 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:49.234913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.247136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca3e45-8dcb-48bc-82f9-cccc8e0202a0 service glance] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.322417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.323118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.323407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.323861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.324583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.328081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.356687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1169/2285] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:49 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:49.361090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.374058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78a3dc-dcb2-49ba-9f5d-ad2b54f65c91 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.379103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.380441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.380727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.381008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.381755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.383394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.395778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1117/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:49.400293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.411395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02690ce9-965a-4417-93eb-ec7ecef6c4d5 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.416564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.417813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.418093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.418370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] PATH_INFO: `/v3/projects/bc91ed131d64427883c38708a84b26dd/users/254554a66fe2482c9d7d3377a8956f31/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.436906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc91ed131d64427883c38708a84b26dd, user_id=254554a66fe2482c9d7d3377a8956f31, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.439919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.476611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1170/2287] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:49 2022] PUT /identity/v3/projects/bc91ed131d64427883c38708a84b26dd/users/254554a66fe2482c9d7d3377a8956f31/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:49.481245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.501466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e42a-4cff-464b-afce-23e357e06833 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.629148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.630159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.630646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.630954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.631928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.634076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbba2ad-0d12-4443-a46e-88347452100a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.646542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1118/2288] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:49.651730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.663544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820945-001e-426f-9658-80c7d7a1dec0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:49.670155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:49.671113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.671406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.671780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] PATH_INFO: `/v3/projects/bc91ed131d64427883c38708a84b26dd/users/254554a66fe2482c9d7d3377a8956f31/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.674323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc91ed131d64427883c38708a84b26dd, user_id=254554a66fe2482c9d7d3377a8956f31, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:49.678331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:49.690662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1171/2289] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:49 2022] PUT /identity/v3/projects/bc91ed131d64427883c38708a84b26dd/users/254554a66fe2482c9d7d3377a8956f31/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:49.702210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:49.702616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:49.702782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:49.731941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:49.735299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] MFA Rules not processed for user `254554a66fe2482c9d7d3377a8956f31`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:49.736760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:49.925485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1119/2290] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:49.937958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:49.940084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:50.036478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd1882-f8ca-486b-b9f1-8be410cfee40 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:50.040737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:50.041715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:50.042124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:50.042522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:50.052609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:50.055313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:50.057267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:50.068826 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1172/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:50.625280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:50.626790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:50.642265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01065712-570e-4ca6-ba2b-70d4ea007dc1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:50.647722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:50.649029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:50.649550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:50.650066 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:50.722573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:50.724371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:50.735019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1120/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:54.889486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:54.901696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f8c6-a95c-4b07-9d29-dd228b49de77 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:54.905024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:54.905681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:54.905997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:54.906276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:54.972293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:54.973797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303812a-867a-4d7c-bea0-43c189a3e152 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:54.983185 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1173/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:57.208642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:57.298808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c7e1-f24a-44ad-99b8-78611df33b87 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:57.304046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:57.304930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:57.305215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:57.305491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] PATH_INFO: `/v3/users/ccc3ba0eaec64c18a0677c3623d968ba` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:57.306674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc3ba0eaec64c18a0677c3623d968ba)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:57.308779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:57.357492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:57.365004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc3ba0eaec64c18a0677c3623d968ba'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.372490 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc3ba0eaec64c18a0677c3623d968ba'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.385576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc3ba0eaec64c18a0677c3623d968ba'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.386229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc3ba0eaec64c18a0677c3623d968ba'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.393232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc3ba0eaec64c18a0677c3623d968ba'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.399186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1121/2294] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:57 2022] DELETE /identity/v3/users/ccc3ba0eaec64c18a0677c3623d968ba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:57.403890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:57.404363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:57.404473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:57.422692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:57.423942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:57.487644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1174/2295] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:57.500484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:57.502722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:57.593097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff79b8-8f77-4497-bed3-28acafca7d7f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:57.596846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:57.597499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:57.597789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:57.598074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:57.607785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:57.609231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:57.619872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1122/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:50:57.902878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:57.904511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:57.923233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcdad7-64e7-4734-b675-bcf4e10389f8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:57.928616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:57.929499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:57.929825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:57.930030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] PATH_INFO: `/v3/projects/0079a5ac96e74b41b4ec61c664f772e0` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:57.931252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0079a5ac96e74b41b4ec61c664f772e0)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:57.933232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:57.981724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0079a5ac96e74b41b4ec61c664f772e0', 'request_id': 'req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.990141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0079a5ac96e74b41b4ec61c664f772e0', 'request_id': 'req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:57.995741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0079a5ac96e74b41b4ec61c664f772e0', 'request_id': 'req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.007482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] The token cache is being invalidate because project 0079a5ac96e74b41b4ec61c664f772e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:58.007769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.008499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.010964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1175/2297] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:57 2022] DELETE /identity/v3/projects/0079a5ac96e74b41b4ec61c664f772e0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:58.014668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:58.026678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925414-df57-46dd-a718-3f404688bb5d service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:58.084441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:58.085329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:58.085642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:58.085921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] PATH_INFO: `/v3/users/7d61faa14b014fd0bac0846f7168b593` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:58.087185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d61faa14b014fd0bac0846f7168b593)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:58.089161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:58.134871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d61faa14b014fd0bac0846f7168b593'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.143971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d61faa14b014fd0bac0846f7168b593'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.151492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:58.169673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d61faa14b014fd0bac0846f7168b593'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.170434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d61faa14b014fd0bac0846f7168b593'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.179173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d61faa14b014fd0bac0846f7168b593'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.185241 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1123/2298] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:58 2022] DELETE /identity/v3/users/7d61faa14b014fd0bac0846f7168b593 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:58.518606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:58.520159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:58.540038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5ff0-1227-4de5-b553-fa4f94ef1d0c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:58.554400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:58.612410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:58.613289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:58.614201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:58.614490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] PATH_INFO: `/v3/projects/dae4f6c2fcba4380b94dcadf18135c21` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:58.615753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae4f6c2fcba4380b94dcadf18135c21)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:58.617785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:58.665160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae4f6c2fcba4380b94dcadf18135c21', 'request_id': 'req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.672705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae4f6c2fcba4380b94dcadf18135c21', 'request_id': 'req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.679573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae4f6c2fcba4380b94dcadf18135c21', 'request_id': 'req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.690664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] The token cache is being invalidate because project dae4f6c2fcba4380b94dcadf18135c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:58.690961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.691643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.693401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1176/2299] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:58 2022] DELETE /identity/v3/projects/dae4f6c2fcba4380b94dcadf18135c21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:58.697521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:58.699144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:58.712614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b42d2-ca4a-45a1-ab61-ed74d1afd8ad admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:58.771153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:58.771989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:58.772282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:58.772569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] PATH_INFO: `/v3/users/254554a66fe2482c9d7d3377a8956f31` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:58.773783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] RBAC: Authorizing `identity:delete_user(user_id=254554a66fe2482c9d7d3377a8956f31)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:58.775770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:58.823742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254554a66fe2482c9d7d3377a8956f31'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.830978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254554a66fe2482c9d7d3377a8956f31'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.844039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254554a66fe2482c9d7d3377a8956f31'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.845367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254554a66fe2482c9d7d3377a8956f31'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.854969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-abd7dfc4-a5f4-426b-bf4e-1339af78416a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254554a66fe2482c9d7d3377a8956f31'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:58.862071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1124/2300] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:50:58 2022] DELETE /identity/v3/users/254554a66fe2482c9d7d3377a8956f31 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:59.132638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.134252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:59.154851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee12c3f-c5b5-4ff4-90ce-dab781b8c177 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.214948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.216339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.216677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.216677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] PATH_INFO: `/v3/projects/bc91ed131d64427883c38708a84b26dd` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.217883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc91ed131d64427883c38708a84b26dd)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.219838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.269695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc91ed131d64427883c38708a84b26dd', 'request_id': 'req-bf4184a0-6831-494c-8c22-699050a223ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:59.272142 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:59.278929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc91ed131d64427883c38708a84b26dd', 'request_id': 'req-bf4184a0-6831-494c-8c22-699050a223ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:59.285666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc91ed131d64427883c38708a84b26dd', 'request_id': 'req-bf4184a0-6831-494c-8c22-699050a223ca'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:59.296668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] The token cache is being invalidate because project bc91ed131d64427883c38708a84b26dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:50:59.296958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:59.297639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bf4184a0-6831-494c-8c22-699050a223ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:50:59.299200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1177/2301] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:50:59 2022] DELETE /identity/v3/projects/bc91ed131d64427883c38708a84b26dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:50:59.305121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.305413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.305718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.326985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:59.328317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:59.382334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:50:59.394348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1125/2302] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:59.403359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.403684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.403968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.424118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:59.425452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:59.443990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1178/2303] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:59.448613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.459076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816320f3-016f-4746-ac16-f89cbc2447c9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.463845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.464514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.464800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.465084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.468099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:50:59.468099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.468323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.486480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1126/2304] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:50:59.487561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.497248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c858a05-4d31-445a-8287-31f9fcdf99cf None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.502086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.502841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.503131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.503403 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.504650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.506724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.546244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1179/2305] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:50:59.553311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.562565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237fd5-9956-457e-a3ba-31526b97ea9c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.627801 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.628608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.628892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.629883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.630704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.633116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.664299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1127/2306] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:50:59.665518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.678866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25d41-e532-4d14-b444-8f1bf518ff94 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.684359 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.685120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.685496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.685851 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.686667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.688438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.699818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1180/2307] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:50:59.703946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.715118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e7090-282e-4459-8cd6-b7322b7f0ef2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.720115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.720806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.721095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.721385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.722165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.724386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24517ffb-c5b8-4bc8-83e4-67d57496edd7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.734502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1128/2308] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:50:59.738809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.749148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52690-5c7e-461e-9e8c-7d4cb7cdc0e2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.753872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.754877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.755193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.755517 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] PATH_INFO: `/v3/projects/ee03825cc387421dba89ebb8754aa511/users/1c35fc1a0d4843c887f8cda036a11932/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.772647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee03825cc387421dba89ebb8754aa511, user_id=1c35fc1a0d4843c887f8cda036a11932, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.775310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:50:59.788954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1181/2309] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:50:59 2022] PUT /identity/v3/projects/ee03825cc387421dba89ebb8754aa511/users/1c35fc1a0d4843c887f8cda036a11932/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:50:59.800384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.800679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.800978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.828302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] MFA Rules not processed for user `1c35fc1a0d4843c887f8cda036a11932`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:50:59.829600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:50:59.909523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1129/2310] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:50:59.914748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:50:59.977399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a6cd6-aeb7-4b41-99e3-cae56c01a208 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:50:59.983083 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:50:59.983810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:50:59.984097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:50:59.984375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:50:59.985085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:50:59.987007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.029304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1182/2311] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:50:59 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:00.033028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.044024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99f47e-1aca-4619-a2da-fc5dea8b5403 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.095187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:00.106115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.106797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.107095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.107373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.108124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.110040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.131914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1130/2312] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:00 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:00.136178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.148167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af79598-5089-41fc-ad6d-2c89a5f8415c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.153566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.154291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.154579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.154864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.155745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.157474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.169289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1183/2313] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:00.174546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.185658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee693cb7-b87d-4ec4-abd3-9c2c34a308fe admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.190956 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.192829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.193116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.193399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] PATH_INFO: `/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab/users/94cf2dcc3d5542f486e777c95d2f66e8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.210303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e9c0de64e64ad88e38cbdc67ecd1ab, user_id=94cf2dcc3d5542f486e777c95d2f66e8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.213083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.227466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1131/2314] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:00 2022] PUT /identity/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab/users/94cf2dcc3d5542f486e777c95d2f66e8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:00.233779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.244280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bb32f-c45f-4ebd-9d33-9048863c5e7f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.296101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:00.311867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.312591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.312906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.313189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.314002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.315662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fdeb1-d790-410b-9e78-446255e64b80 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.326813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1184/2315] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:00.330948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.341737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1c639-ad48-4fb5-b52f-609073a01644 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.346907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.347778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.348110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.348393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] PATH_INFO: `/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab/users/94cf2dcc3d5542f486e777c95d2f66e8/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.350587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e9c0de64e64ad88e38cbdc67ecd1ab, user_id=94cf2dcc3d5542f486e777c95d2f66e8, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.353295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.364735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1132/2316] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:00 2022] PUT /identity/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab/users/94cf2dcc3d5542f486e777c95d2f66e8/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:00.376707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.376831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.377114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.406413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] MFA Rules not processed for user `94cf2dcc3d5542f486e777c95d2f66e8`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:00.407663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:00.481879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1185/2317] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:00.494383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.496159 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:00.563381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d20807-30af-416e-9054-7c07175668cb admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.567696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.568359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.568648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.568934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.578597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.580091 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.590799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1133/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:00.674788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:00.685387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c219-e194-4777-8fbc-9623abac5427 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:00.689123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:00.689780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:00.690070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:00.690349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:00.760808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:00.762396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42230f-208b-4a3c-9993-4ea185b5bc6a service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:00.772880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1186/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:51:05.648958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:05.714788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520802e-e8d9-442b-b27e-52434aa82db1 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:05.719749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:05.720627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:05.720916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:05.721200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] PATH_INFO: `/v3/users/1c35fc1a0d4843c887f8cda036a11932` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:05.722407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c35fc1a0d4843c887f8cda036a11932)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:05.725029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:05.771731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c35fc1a0d4843c887f8cda036a11932'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:05.774819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:05.782094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c35fc1a0d4843c887f8cda036a11932'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:05.798254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c35fc1a0d4843c887f8cda036a11932'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:05.798916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c35fc1a0d4843c887f8cda036a11932'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:05.805866 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c35fc1a0d4843c887f8cda036a11932'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:05.811858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1134/2320] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:05 2022] DELETE /identity/v3/users/1c35fc1a0d4843c887f8cda036a11932 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:05.816421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:05.816950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:05.817061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:05.834812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:05.836140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:05.897024 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1187/2321] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:05.907098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:05.908627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:05.968012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1618-4121-4a33-989c-1eafae87ec92 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:05.971830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:05.972488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:05.972778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:05.973056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:05.982908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:05.984383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:05.994421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1135/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:06.266580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:06.268128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:06.283995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b8679-9755-455d-b69b-2f5bc8cfc6bc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:06.289831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:06.290701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:06.292127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:06.292427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] PATH_INFO: `/v3/projects/ee03825cc387421dba89ebb8754aa511` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:06.294323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee03825cc387421dba89ebb8754aa511)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:06.297780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:06.302592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:06.360808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee03825cc387421dba89ebb8754aa511', 'request_id': 'req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.369169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee03825cc387421dba89ebb8754aa511', 'request_id': 'req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.375109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee03825cc387421dba89ebb8754aa511', 'request_id': 'req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.390213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] The token cache is being invalidate because project ee03825cc387421dba89ebb8754aa511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:06.390507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.391252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.392776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1188/2323] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:06 2022] DELETE /identity/v3/projects/ee03825cc387421dba89ebb8754aa511 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:06.396907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:06.406952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1769f-f416-4c0f-a589-6110d699f569 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:06.464717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:06.465845 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:06.466131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:06.466407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] PATH_INFO: `/v3/users/94cf2dcc3d5542f486e777c95d2f66e8` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:06.467629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94cf2dcc3d5542f486e777c95d2f66e8)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:06.469563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:06.517339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94cf2dcc3d5542f486e777c95d2f66e8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.526522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94cf2dcc3d5542f486e777c95d2f66e8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.539654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94cf2dcc3d5542f486e777c95d2f66e8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.540359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94cf2dcc3d5542f486e777c95d2f66e8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.541644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:06.549902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b04ceb1b-864f-4290-90fd-49f5ca6894e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94cf2dcc3d5542f486e777c95d2f66e8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:06.556632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1136/2324] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:06 2022] DELETE /identity/v3/users/94cf2dcc3d5542f486e777c95d2f66e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:06.850643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:06.852175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:06.865520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee3e3-0e03-47c2-976f-f1dd3b0780a3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:06.930684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:06.932181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:06.932632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:06.933114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] PATH_INFO: `/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:06.935113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e9c0de64e64ad88e38cbdc67ecd1ab)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:06.938635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:06.992764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e9c0de64e64ad88e38cbdc67ecd1ab', 'request_id': 'req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.000758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e9c0de64e64ad88e38cbdc67ecd1ab', 'request_id': 'req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.007582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e9c0de64e64ad88e38cbdc67ecd1ab', 'request_id': 'req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.021613 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] The token cache is being invalidate because project b8e9c0de64e64ad88e38cbdc67ecd1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:07.021911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.022578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d5ea87fb-a4d0-4a48-8a73-3877c9196e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.024183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1189/2325] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:06 2022] DELETE /identity/v3/projects/b8e9c0de64e64ad88e38cbdc67ecd1ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:07.029096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.029551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.029858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.049612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:07.051527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:07.110406 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1137/2326] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:07.118703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.118994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.119276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.138516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:07.139781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:07.148045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1190/2327] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:07.152463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.162194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf1eca-5803-458e-b9e3-ac22ac37dc99 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.166800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.167477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.167784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.168070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.168814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:51:07.169129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.170734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.184184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1138/2328] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:51:07.188651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.198717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b47cbd-a805-44c1-9140-0d1ae34d0c25 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.203612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.204310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.204634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.204959 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.205706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.207797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.221319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:07.235769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1191/2329] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:07.240443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.250414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b022ee-ab0e-4e39-889c-f3720dcbb32c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.306531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.307288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.307612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.307890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.308651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.310587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.331469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1139/2330] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:07.336250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.347056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2411cb4-5fef-494f-9888-e21eb2bfe614 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.351968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.352670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.352958 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.353293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.354015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.355703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.368214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1192/2331] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:07.372119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.383151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026e23-9ed7-416f-8581-7fbe3f889550 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.387758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.388430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.388720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.389000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.389757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.391348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9b442-4d90-4033-a9ac-4805c29c8194 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.402012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1140/2332] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:07.406369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.416946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2108c5-8328-42e0-b930-f5899ccdd52f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.421594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.422472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.422759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.423035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] PATH_INFO: `/v3/projects/522dd00c793c489cb5b528c8f95bf793/users/bf3fd133dcec464492a3010aca7e0ec5/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.439636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522dd00c793c489cb5b528c8f95bf793, user_id=bf3fd133dcec464492a3010aca7e0ec5, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.442834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.458930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1193/2333] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:07 2022] PUT /identity/v3/projects/522dd00c793c489cb5b528c8f95bf793/users/bf3fd133dcec464492a3010aca7e0ec5/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:07.469359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.469659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.469943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.498142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] MFA Rules not processed for user `bf3fd133dcec464492a3010aca7e0ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:07.499632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:07.548463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:07.571316 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1141/2334] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:07.582345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.584072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:07.644828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c0572-a79a-4f45-9ca4-490178094b40 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.648477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.649127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.649415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.649695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.658177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.659641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a69e8-1a3c-435b-84db-a1821b4f169a service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.669113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1194/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:07.688236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.755414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd98706-4b2d-4a18-8560-5e5567b9ecf3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:07.760081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:07.761418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.761418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.761630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] PATH_INFO: `/v3/users/bf3fd133dcec464492a3010aca7e0ec5` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.762807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3fd133dcec464492a3010aca7e0ec5)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:07.764772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:07.818619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3fd133dcec464492a3010aca7e0ec5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.827015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3fd133dcec464492a3010aca7e0ec5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.840973 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3fd133dcec464492a3010aca7e0ec5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.841876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3fd133dcec464492a3010aca7e0ec5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.850584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3fd133dcec464492a3010aca7e0ec5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:07.858044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1142/2336] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:07 2022] DELETE /identity/v3/users/bf3fd133dcec464492a3010aca7e0ec5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:07.862673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:07.863154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:07.863276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:07.882942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:07.884222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:07.945713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1195/2337] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:07.955767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:07.957685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:08.021201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338d0a-aab7-4786-b9c5-ac934e56df20 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.024963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.025802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.026121 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.026528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.038008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.039629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f125-82a9-441b-9e3a-f525033d31d8 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.051907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1143/2338] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:51:08.329511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.331315 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:08.349355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae544d3-1410-4265-ae4f-54700c2c08c3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.356383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.357262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.357600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.357865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] PATH_INFO: `/v3/projects/522dd00c793c489cb5b528c8f95bf793` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.359026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=522dd00c793c489cb5b528c8f95bf793)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.360985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.411810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522dd00c793c489cb5b528c8f95bf793', 'request_id': 'req-d7193772-7c5a-41db-a6a6-af277640ad0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:08.423300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522dd00c793c489cb5b528c8f95bf793', 'request_id': 'req-d7193772-7c5a-41db-a6a6-af277640ad0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:08.424669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:08.431731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522dd00c793c489cb5b528c8f95bf793', 'request_id': 'req-d7193772-7c5a-41db-a6a6-af277640ad0c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:08.445686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] The token cache is being invalidate because project 522dd00c793c489cb5b528c8f95bf793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:08.445976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:08.446624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d7193772-7c5a-41db-a6a6-af277640ad0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:08.448260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1196/2339] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:08 2022] DELETE /identity/v3/projects/522dd00c793c489cb5b528c8f95bf793 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:08.453332 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152266-fa30-48f6-9a46-3e022db809be None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.453628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152266-fa30-48f6-9a46-3e022db809be None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.453915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152266-fa30-48f6-9a46-3e022db809be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.468086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:08.474719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-90152266-fa30-48f6-9a46-3e022db809be None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:08.476695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-90152266-fa30-48f6-9a46-3e022db809be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:08.538686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1144/2340] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:08.603921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.604422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.604422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.623615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:08.624835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:08.633790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1197/2341] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:08.637995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90152266-fa30-48f6-9a46-3e022db809be None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.648231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90152266-fa30-48f6-9a46-3e022db809be None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.652591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.653359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.653714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.654064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.654917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:51:08.655292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.657016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.669448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1145/2342] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:51:08.673781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.683734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667fd91-3bff-4546-a918-488fbe32192d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.688397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.689040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.689326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.689604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.690296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.693005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.718875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1198/2343] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:51:08 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:08.722852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.732915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586854-2060-4609-8d64-9002ced5bde3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.796078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.796755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.797045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.797349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.798032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.800020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.821906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1146/2344] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:08 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:08.825925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.836108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74b967-dbd2-40aa-9fc5-4c0ef2ad8e0b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.842558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.843293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.843615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.843956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.844666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.846291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.860239 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1199/2345] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:08.863822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.874139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c817ff-243f-4c85-88aa-3965b663e052 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.879658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.880326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.880642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.880924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.881657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.883246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a1a06-2574-44dd-9ad7-6cc4cc2bb375 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.893966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1147/2346] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:08.898168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:08.908624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076c70-a6b3-4c3a-8691-5f5eb581da64 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:08.914061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:08.914945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.915229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.915537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] PATH_INFO: `/v3/projects/cdd856c7870b45c199c562bb60d55423/users/fe03a46a2509408899d968190fe6e0b5/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.931692 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd856c7870b45c199c562bb60d55423, user_id=fe03a46a2509408899d968190fe6e0b5, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:08.934972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:08.950711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1200/2347] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:08 2022] PUT /identity/v3/projects/cdd856c7870b45c199c562bb60d55423/users/fe03a46a2509408899d968190fe6e0b5/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:08.961128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:08.961431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:08.961739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:08.989636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] MFA Rules not processed for user `fe03a46a2509408899d968190fe6e0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:08.990771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.053310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1148/2348] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:09.064347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:09.066084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.123567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a06c9-3ce9-4d7b-8472-208ad59f7d55 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:09.127529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:09.128272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.128634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.128991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.140685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:09.144302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba918-029c-4e49-bb9f-f201e9f223b8 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:09.154410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1201/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:09.174069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:09.179125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:09.239849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c41b-7144-4d92-91b1-4a1da2c8f68f None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:09.244495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:09.245405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.245698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.245979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] PATH_INFO: `/v3/users/fe03a46a2509408899d968190fe6e0b5` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.247200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe03a46a2509408899d968190fe6e0b5)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:09.249192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:09.295248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe03a46a2509408899d968190fe6e0b5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.302443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe03a46a2509408899d968190fe6e0b5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.314570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe03a46a2509408899d968190fe6e0b5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.315223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe03a46a2509408899d968190fe6e0b5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.322502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe03a46a2509408899d968190fe6e0b5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.329458 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1149/2350] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:09 2022] DELETE /identity/v3/users/fe03a46a2509408899d968190fe6e0b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:09.336143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf62b-ed29-4589-852c-267aee726997 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.336458 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf62b-ed29-4589-852c-267aee726997 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.336743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf62b-ed29-4589-852c-267aee726997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.361682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-55caf62b-ed29-4589-852c-267aee726997 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:09.364527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-55caf62b-ed29-4589-852c-267aee726997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.432372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1202/2351] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:09.442022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:09.443408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.501149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5294e38-a962-475d-9758-56fcb3fb2124 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:09.504773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:09.505424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.505714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.505998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.515293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:09.516781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195820b6-72a1-445f-88ac-c038cf0ba005 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:09.527421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1150/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:09.810788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf62b-ed29-4589-852c-267aee726997 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:09.812511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-55caf62b-ed29-4589-852c-267aee726997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.826699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf62b-ed29-4589-852c-267aee726997 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:09.832689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:09.833591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.833872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.834642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] PATH_INFO: `/v3/projects/cdd856c7870b45c199c562bb60d55423` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.835406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd856c7870b45c199c562bb60d55423)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:09.837644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:09.860397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:09.889496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd856c7870b45c199c562bb60d55423', 'request_id': 'req-2973cc98-fdae-444b-85a1-72e139bf75c9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.898578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd856c7870b45c199c562bb60d55423', 'request_id': 'req-2973cc98-fdae-444b-85a1-72e139bf75c9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.906983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd856c7870b45c199c562bb60d55423', 'request_id': 'req-2973cc98-fdae-444b-85a1-72e139bf75c9'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.918588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] The token cache is being invalidate because project cdd856c7870b45c199c562bb60d55423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:09.918860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.919642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2973cc98-fdae-444b-85a1-72e139bf75c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:09.921314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1203/2353] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:09 2022] DELETE /identity/v3/projects/cdd856c7870b45c199c562bb60d55423 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:09.926206 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:09.926714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:09.927113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:09.946624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:09.947885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:09.967434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:10.009937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1151/2354] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:10.018012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.018330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.018652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.038970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:10.040242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:10.048872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1204/2355] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:10.053800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.065603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f910a-7d05-45a7-845c-d8ef0bacfc50 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.071258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.071971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.072262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.072542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.073299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:51:10.073616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.079526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.095681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1152/2356] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:51:10.100023 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.109318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af330578-1e54-4392-85d6-a63167f51e41 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.115095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.115802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.116081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.116355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.117052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.118953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.145201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1205/2357] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:10.149521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.159886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8d44-fda1-43cd-8cfd-b4ff0f2b6e6a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.223805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.224529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.224812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.225099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.225824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.227846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.249376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1153/2358] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:10 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:10.253482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.264876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04108d-9c3d-4721-9f91-3ff39d149747 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.269520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.270332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.270709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.270890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.271651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.273243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.284630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1206/2359] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:10.288765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.298706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51f50d-e78a-4e8f-972c-1d69fc6cd44a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.303922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.304583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.304876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.305161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.305898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.307530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b402a3-df03-4160-af8c-fe22a1a6fab6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.318301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1154/2360] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:10.322323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.332358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaf7e4-b393-4e30-84fd-dfd0d03e3466 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.336990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.337902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.338184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.338462 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] PATH_INFO: `/v3/projects/7c627f98f16d4b34b9c521014097384f/users/f0eb77b431ec4cbea335ad1591da26cf/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.354369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c627f98f16d4b34b9c521014097384f, user_id=f0eb77b431ec4cbea335ad1591da26cf, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.357061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.378086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1207/2361] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:10 2022] PUT /identity/v3/projects/7c627f98f16d4b34b9c521014097384f/users/f0eb77b431ec4cbea335ad1591da26cf/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:10.389984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.390281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.390567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.417334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] MFA Rules not processed for user `f0eb77b431ec4cbea335ad1591da26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:10.418534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:10.486161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1155/2362] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:10.497607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:10.499295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:10.559406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf326-7e53-4a0b-a8bd-b4e32cd8edfb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:10.563095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:10.563775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:10.564056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:10.564331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:10.572663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:10.574095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40f2e3-3466-468b-957f-6836ecac1d10 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:10.583012 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1208/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:16.715978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:16.736425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:16.780546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e3fad-ef3d-4d58-ac5a-43211270aa99 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:16.785111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:16.785986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:16.786276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:16.786560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] PATH_INFO: `/v3/users/f0eb77b431ec4cbea335ad1591da26cf` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:16.787817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0eb77b431ec4cbea335ad1591da26cf)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:16.789798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:16.837077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0eb77b431ec4cbea335ad1591da26cf'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:16.844739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0eb77b431ec4cbea335ad1591da26cf'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:16.856699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0eb77b431ec4cbea335ad1591da26cf'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:16.857364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0eb77b431ec4cbea335ad1591da26cf'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:16.864691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0eb77b431ec4cbea335ad1591da26cf'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:16.871147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1156/2364] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:16 2022] DELETE /identity/v3/users/f0eb77b431ec4cbea335ad1591da26cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:16.875827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:16.876293 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:16.876390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:16.893577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:16.894770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:16.938316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:16.958923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1209/2365] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:16.968865 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:16.970265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:17.028043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33060-f5bf-45df-9332-5965117694c5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:17.031955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:17.032352 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:17.032673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:17.032919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:17.043833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:17.045280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:17.056572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1157/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:17.333249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:17.334791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:17.347320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37417a3-31fc-45a2-90e8-3c3e1c05d4d8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:17.352081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:17.352957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:17.353237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:17.354219 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] PATH_INFO: `/v3/projects/7c627f98f16d4b34b9c521014097384f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:17.354869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c627f98f16d4b34b9c521014097384f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:17.356875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:17.405156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c627f98f16d4b34b9c521014097384f', 'request_id': 'req-08ca93af-ece7-49d0-932a-6bb676e1a179'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:17.412548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c627f98f16d4b34b9c521014097384f', 'request_id': 'req-08ca93af-ece7-49d0-932a-6bb676e1a179'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:17.419084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c627f98f16d4b34b9c521014097384f', 'request_id': 'req-08ca93af-ece7-49d0-932a-6bb676e1a179'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:17.431013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] The token cache is being invalidate because project 7c627f98f16d4b34b9c521014097384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:17.431310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:17.432001 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-08ca93af-ece7-49d0-932a-6bb676e1a179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:17.433557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1210/2367] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:17 2022] DELETE /identity/v3/projects/7c627f98f16d4b34b9c521014097384f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:51:26.398070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:26.399499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:26.449454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:26.475416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0d71-93aa-4cc5-b7a0-897756630ee7 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:26.560042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:26.560709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:26.561001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:26.561281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:26.563123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:26.581351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:26.583154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:26.596167 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1158/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:27.427795 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:29.206362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:29.207162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:29.207162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:29.229974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:29.231358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:29.293660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1211/2369] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:29.399698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:29.401624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:29.475266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b4c3-62ee-49c9-bd8d-b63a874f66b9 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:29.481658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:29.482401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:29.482690 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:29.482969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:29.491604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:29.493281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669b75-2ffc-4449-a89f-af94f97b25b3 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:29.504848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1159/2370] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:30.128067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:30.129491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.141934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d01b8-8447-4bc1-8fe5-875b35143a11 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:30.146593 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:30.147770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.148060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.149016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] PATH_INFO: `/v3/users/5c7ada3d45b643888e032bde5849e760` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.150226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7ada3d45b643888e032bde5849e760)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:30.152214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:30.207420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7ada3d45b643888e032bde5849e760'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.215050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7ada3d45b643888e032bde5849e760'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.227418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7ada3d45b643888e032bde5849e760'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.234370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7ada3d45b643888e032bde5849e760'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.235013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7ada3d45b643888e032bde5849e760'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.241419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1212/2371] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:30 2022] DELETE /identity/v3/users/5c7ada3d45b643888e032bde5849e760 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:30.246451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.246748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.247034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.265404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:30.266722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.322642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:30.331773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1160/2372] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:30.341624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:30.343031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.400625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162da1d-5d92-4bea-9857-cefcd44922f3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:30.404388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:30.405071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.405361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.405644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.415089 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:30.416621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10b22-7f69-435d-9414-f1a0a31e09c7 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:30.426308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1213/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:30.702003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:30.703571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.718098 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a73171-eac0-48cb-baa8-74737888c3bd None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:30.723101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:30.724083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.724371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.724655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] PATH_INFO: `/v3/projects/b1aa01150eb445719e16c4a886175bbc` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.725905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aa01150eb445719e16c4a886175bbc)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:30.728394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:30.784219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aa01150eb445719e16c4a886175bbc', 'request_id': 'req-ed9117b3-ac3f-45b0-a785-27d05e4be1df'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.792001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aa01150eb445719e16c4a886175bbc', 'request_id': 'req-ed9117b3-ac3f-45b0-a785-27d05e4be1df'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.797649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aa01150eb445719e16c4a886175bbc', 'request_id': 'req-ed9117b3-ac3f-45b0-a785-27d05e4be1df'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.809166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] The token cache is being invalidate because project b1aa01150eb445719e16c4a886175bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:30.809522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.810084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ed9117b3-ac3f-45b0-a785-27d05e4be1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:30.811675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1161/2374] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:30 2022] DELETE /identity/v3/projects/b1aa01150eb445719e16c4a886175bbc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:51:30.817025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.817326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.817608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.835014 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:30.836329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.846082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:30.898282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1214/2375] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:30.905842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.906130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.906404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.925775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:30.926985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:30.935971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1162/2376] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:30.940461 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:30.950265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455f0cf-62eb-4cb7-9705-41327a3136ab None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:30.954981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:30.955681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.955972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.956253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.956998 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:51:30.957313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:30.958980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:30.971653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1215/2377] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:51:30.975896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:30.986016 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc976c-74a2-4d1f-81da-2578e5a38364 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:30.990751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:30.991419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:30.991743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:30.992029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:30.993225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:30.995170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.024193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1163/2378] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:51:30 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:31.028301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:31.038645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb84b99-54ac-4d22-aa36-a6430381743e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:31.095883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:31.096550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.096835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.097113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.097827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:31.099789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.119587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1216/2379] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:31 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:31.123810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:31.134861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71e75-57a3-415e-afaa-04789b601884 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:31.139404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:31.140107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.140387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.140693 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.141428 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:31.143014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.153408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1164/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:31.157447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:31.168092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a38a24-751e-48bf-ab64-3b8270eb0eba admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:31.172806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:31.173591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.174145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.174437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.175685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:31.177741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2634b-e1a0-41c3-9b4e-e4fd27716560 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.189252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1217/2381] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:31.193317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:31.204022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739384e-47c4-40ba-a3e2-d2ff46bf8960 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:31.208701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:31.209584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.209871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.210151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] PATH_INFO: `/v3/projects/278a4ebb5c494b91a5540fd7ab438c8c/users/a2db557375854ec9bdd3702815d990b4/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.225173 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278a4ebb5c494b91a5540fd7ab438c8c, user_id=a2db557375854ec9bdd3702815d990b4, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:31.227862 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.240993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1165/2382] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:31 2022] PUT /identity/v3/projects/278a4ebb5c494b91a5540fd7ab438c8c/users/a2db557375854ec9bdd3702815d990b4/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:51:31.252751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951014-1c90-4f56-a2f4-c4c241fbe1df None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.253243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951014-1c90-4f56-a2f4-c4c241fbe1df None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.253355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c951014-1c90-4f56-a2f4-c4c241fbe1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.281035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1c951014-1c90-4f56-a2f4-c4c241fbe1df None None] MFA Rules not processed for user `a2db557375854ec9bdd3702815d990b4`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:31.282278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1c951014-1c90-4f56-a2f4-c4c241fbe1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:31.348136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1218/2383] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:31.360491 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:31.362187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:31.419641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c44221-c4ca-4527-8ea2-9009bb69c352 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:31.423342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:31.424025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:31.424313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:31.424600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:31.433627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:31.435061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:31.444036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1166/2384] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:33.281938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:33.282554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:33.282554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:33.301009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:33.302143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:33.308103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:33.363843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1219/2385] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:33.391107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:33.392606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:33.419610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:33.468417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f680a3-077a-460d-9265-9b04432c767d service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:33.473957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:33.474605 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:33.474890 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:33.475172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:33.483527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:33.485117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a2780-a80b-4e2d-8660-7756ca6c1dbe service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:33.495073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1167/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:34.002827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.013237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f582a-1dcf-44bb-b9a2-ade1345635bf None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.023155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.024570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.024854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.025130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] PATH_INFO: `/v3/users/a2db557375854ec9bdd3702815d990b4` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.026342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2db557375854ec9bdd3702815d990b4)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.028312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.076482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2db557375854ec9bdd3702815d990b4'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.083935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2db557375854ec9bdd3702815d990b4'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.096949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2db557375854ec9bdd3702815d990b4'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.104374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2db557375854ec9bdd3702815d990b4'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.105082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2db557375854ec9bdd3702815d990b4'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.111008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1220/2387] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:34 2022] DELETE /identity/v3/users/a2db557375854ec9bdd3702815d990b4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:34.115828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.116150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.116427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.134300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:34.135613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:34.195708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1168/2388] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:34.205028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.206446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:34.266090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dfbb7-1526-4801-ba0b-76661355aac5 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.269835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.270485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.270774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.271058 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.280707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.282153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79347-29a0-49a5-a068-16cd42e261da service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.292410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1221/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:34.575223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.577299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:34.593368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25363fe4-d4a9-4915-b729-a535507c1523 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.600981 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.601923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.602226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.602543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] PATH_INFO: `/v3/projects/278a4ebb5c494b91a5540fd7ab438c8c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.603824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278a4ebb5c494b91a5540fd7ab438c8c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.605858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.654463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278a4ebb5c494b91a5540fd7ab438c8c', 'request_id': 'req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.662108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278a4ebb5c494b91a5540fd7ab438c8c', 'request_id': 'req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.668272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278a4ebb5c494b91a5540fd7ab438c8c', 'request_id': 'req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.679258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] The token cache is being invalidate because project 278a4ebb5c494b91a5540fd7ab438c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:34.680082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.680732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-31ddbbf2-9524-4a95-b5e5-1769e2640dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:34.682282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1169/2390] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:34 2022] DELETE /identity/v3/projects/278a4ebb5c494b91a5540fd7ab438c8c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:34.687265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.687600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.687889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.705861 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:34.707134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:34.728028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:34.768942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1222/2391] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:34.776945 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.777254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.777511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.796096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:34.797319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:34.806009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1170/2392] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:34.810556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.821128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465645d-4766-4bc5-8d7f-ff0ce59c7d69 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.825734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.826388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.826675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.826954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.827725 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:51:34.828041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.829646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.842035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1223/2393] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:51:34.846443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.856923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449957-ce67-4d31-b9d4-63340bb44334 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.861774 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.862381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.862670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.862953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.863691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.865672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.894320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1171/2394] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:51:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:51:34.899241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:34.909612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3541b-9ffc-472a-9831-97764ad51771 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:34.965062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:34.965730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:34.966279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:34.966555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:34.967249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:34.969203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:34.990555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1224/2395] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:51:34 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:51:34.994676 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.000111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:35.006046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bc54e-e40e-459c-863e-5c65a8cf47e8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.014042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.015032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.015327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.015645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.016730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.019178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.032079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1172/2396] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:51:35.036275 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.047688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978505f6-05b5-4ee9-8230-967aece850c7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.053077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.053745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.054032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.054313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.055086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.057153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2067b4-5d07-46ec-8335-43e023d356d4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.068041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1225/2397] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:51:35.073184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.083661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65472-3141-463f-960b-cc565e5194f4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.089161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.090050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.090341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.090625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] PATH_INFO: `/v3/projects/b66493c1de254ef3af8c2f7ad87e00f1/users/2a3810f88a82487db242cf937ff5a2dd/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.107601 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66493c1de254ef3af8c2f7ad87e00f1, user_id=2a3810f88a82487db242cf937ff5a2dd, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.110345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.124200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1173/2398] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:51:35 2022] PUT /identity/v3/projects/b66493c1de254ef3af8c2f7ad87e00f1/users/2a3810f88a82487db242cf937ff5a2dd/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:35.134845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.135165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.135476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.162306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] MFA Rules not processed for user `2a3810f88a82487db242cf937ff5a2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:35.163561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:35.229783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1226/2399] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:35.241148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.242851 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:35.300040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be532-d9b6-438f-aed8-33977a1e3cb9 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.303874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.304524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.304809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.305085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.313649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.315103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13c25a-bc14-4efe-acff-1efd3697dd0c service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.325741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1174/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:35.354492 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.379834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:35.419165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba611e4-c873-41c6-a676-74b22816d23e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.423907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.424782 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.425067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.425379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] PATH_INFO: `/v3/users/2a3810f88a82487db242cf937ff5a2dd` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.426631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3810f88a82487db242cf937ff5a2dd)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.428611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.478873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3810f88a82487db242cf937ff5a2dd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:35.487242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3810f88a82487db242cf937ff5a2dd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:35.502577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3810f88a82487db242cf937ff5a2dd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:35.509707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3810f88a82487db242cf937ff5a2dd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:35.510474 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3810f88a82487db242cf937ff5a2dd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:35.517451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1227/2401] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:51:35 2022] DELETE /identity/v3/users/2a3810f88a82487db242cf937ff5a2dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:35.521970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.522266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.522549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.541534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:35.542773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:35.606642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1175/2402] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:51:35.616224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.618287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:35.676440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07243c-5653-4cb8-9fde-c89ecebc27a7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.680578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.681227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.681516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.681798 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.691169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.692651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3b13-f4ea-4253-b691-31ef673f2163 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:35.702863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1228/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:35.973494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:35.975100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:35.988543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0443a8-d87b-4ae8-b38d-71a98b389041 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:35.994401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:35.995275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:35.995604 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:35.995889 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] PATH_INFO: `/v3/projects/b66493c1de254ef3af8c2f7ad87e00f1` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:35.997123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66493c1de254ef3af8c2f7ad87e00f1)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:35.999096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:36.058318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66493c1de254ef3af8c2f7ad87e00f1', 'request_id': 'req-9963cf02-b6ad-4c75-b8dc-e150369d8422'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:36.066178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66493c1de254ef3af8c2f7ad87e00f1', 'request_id': 'req-9963cf02-b6ad-4c75-b8dc-e150369d8422'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:36.072527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66493c1de254ef3af8c2f7ad87e00f1', 'request_id': 'req-9963cf02-b6ad-4c75-b8dc-e150369d8422'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:36.073623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:36.087100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] The token cache is being invalidate because project b66493c1de254ef3af8c2f7ad87e00f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:51:36.087644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:36.088266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:51:36.089915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1176/2404] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:51:35 2022] DELETE /identity/v3/projects/b66493c1de254ef3af8c2f7ad87e00f1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:51:37.605416 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207f86-8ee2-46b8-a4ea-e0357be9164a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:37.605979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207f86-8ee2-46b8-a4ea-e0357be9164a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:37.605979 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207f86-8ee2-46b8-a4ea-e0357be9164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:37.624527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1f207f86-8ee2-46b8-a4ea-e0357be9164a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:37.625837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1f207f86-8ee2-46b8-a4ea-e0357be9164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:37.668627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:51:37.694568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1229/2405] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:37.708871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:37.710279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:37.785496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963cf02-b6ad-4c75-b8dc-e150369d8422 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:37.791666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:37.792657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:37.792657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:37.792869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:37.801103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:37.802704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:37.812165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1177/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:41.705096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cc8b-9d5c-4f8a-b1a8-ada9c0ab1196 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:41.705590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cc8b-9d5c-4f8a-b1a8-ada9c0ab1196 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:41.705703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cc8b-9d5c-4f8a-b1a8-ada9c0ab1196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:41.723899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-40e3cc8b-9d5c-4f8a-b1a8-ada9c0ab1196 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:41.725087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-40e3cc8b-9d5c-4f8a-b1a8-ada9c0ab1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:41.732931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1230/2407] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:51:41.748069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:41.749498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:41.765290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e24ff-9d4c-452f-a403-fdf3323e90ee service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:41.770917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:41.771593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:41.771882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:41.772162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:41.780867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:41.782464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:41.793897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1178/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:51:45.857773 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2a7b6-7a12-4137-9b6b-ce7f79f65490 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:45.858262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2a7b6-7a12-4137-9b6b-ce7f79f65490 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:45.858378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2a7b6-7a12-4137-9b6b-ce7f79f65490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:45.877379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-76c2a7b6-7a12-4137-9b6b-ce7f79f65490 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:45.878590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-76c2a7b6-7a12-4137-9b6b-ce7f79f65490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:45.887091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1231/2409] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:45.908911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:45.920962 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe6a72-dfdb-48c4-9082-93e9a728e4ca service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:45.927753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:45.928447 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:45.928735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:45.929134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:45.939538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:45.941171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:45.953194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1179/2410] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:51.119081 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80ce3-9a1b-4607-a438-bbb7a9e04faf None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:51.119634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80ce3-9a1b-4607-a438-bbb7a9e04faf None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:51.119740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80ce3-9a1b-4607-a438-bbb7a9e04faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:51.140400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e0a80ce3-9a1b-4607-a438-bbb7a9e04faf None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:51.141652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e0a80ce3-9a1b-4607-a438-bbb7a9e04faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:51.150119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1232/2411] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:51:51.166629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:51:51.180859 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f98537-7f24-40bb-963a-f56bca123377 service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:51:51.187288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:51:51.187993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:51.188286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:51.188573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:51.198437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:51:51.200175 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b532f9-062a-4e41-8e14-c1e473f4e3b4 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:51:51.211782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1180/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:51:51.588986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0806-5eef-4368-87f4-77c34a9818d8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:51:51.589279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0806-5eef-4368-87f4-77c34a9818d8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:51:51.589563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0806-5eef-4368-87f4-77c34a9818d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:51:51.607524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d8ca0806-5eef-4368-87f4-77c34a9818d8 None None] MFA Rules not processed for user `5d0090359d7c46038b82bbb903abab93`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:51:51.609031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d8ca0806-5eef-4368-87f4-77c34a9818d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:51:51.664328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1233/2413] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:51:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:01.206093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=55 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:52:01.657601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=41 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:52:11.141164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:11.141661 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:11.141846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:11.161709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] MFA Rules not processed for user `bf26b8412da548bd98a461445b3bd09c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:11.163587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:11.364106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1181/2414] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:52:19.331701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cf35-7569-43f0-88f6-198ebe7f972a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:19.332270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cf35-7569-43f0-88f6-198ebe7f972a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:19.332553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75cf35-7569-43f0-88f6-198ebe7f972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:19.358451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-eb75cf35-7569-43f0-88f6-198ebe7f972a None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:19.360300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eb75cf35-7569-43f0-88f6-198ebe7f972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:19.417850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1234/2415] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:19.466045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:19.467732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:19.543117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0d4f-cbe7-4b8d-b3e7-debe38b9bcaa None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:19.548252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:19.548894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:19.549181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:19.549472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:19.560828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:19.562436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:19.570816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1182/2416] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:52:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:52:26.772705 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d877-40fc-4b49-a11d-eaba04bd285f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:26.773307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d877-40fc-4b49-a11d-eaba04bd285f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:26.773649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d877-40fc-4b49-a11d-eaba04bd285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:26.795394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a853d877-40fc-4b49-a11d-eaba04bd285f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:26.796561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a853d877-40fc-4b49-a11d-eaba04bd285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:26.806843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1235/2417] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:26.821307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:26.837450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0c82-cb4a-491d-94c3-eae84b471389 service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:26.843894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:26.844813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:26.845273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:26.845708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:26.857234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:26.858797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:26.877335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1183/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:31.115178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dbc2b-727e-4bda-9cb5-f07d98c6258e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:31.115765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dbc2b-727e-4bda-9cb5-f07d98c6258e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:31.115907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dbc2b-727e-4bda-9cb5-f07d98c6258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:31.135480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-745dbc2b-727e-4bda-9cb5-f07d98c6258e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:31.136900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-745dbc2b-727e-4bda-9cb5-f07d98c6258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:31.148395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1236/2419] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:31.161573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:31.173192 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87451-cbeb-4aac-8dda-e959b9e930e0 service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:31.180201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:31.181220 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:31.181758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:31.182253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:31.191852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:31.193418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3196913-e167-4439-8f5d-4755259e0bbb service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:31.204341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1184/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:35.724510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:35.725162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:35.725162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:35.726449 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1237/2421] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:52:35.732369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f80ef-803a-4b39-8639-2d2bab18a005 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:35.732875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f80ef-803a-4b39-8639-2d2bab18a005 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:35.732995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f80ef-803a-4b39-8639-2d2bab18a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:35.739264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=70 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:52:35.753343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-fb9f80ef-803a-4b39-8639-2d2bab18a005 None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:35.754584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fb9f80ef-803a-4b39-8639-2d2bab18a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:35.764573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1185/2422] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:35.776712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:35.778505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:35.839105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8c2f1-7a8b-403a-b48a-99c946967446 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:35.842932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:35.843618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:35.843908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:35.844186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:35.855832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:35.857496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83208ea0-85e6-46ee-bbbe-8e64ca6517ff service glance] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:35.869451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1238/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:35.936209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:35.936474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:35.936787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] PATH_INFO: `/` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:35.938164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1186/2424] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:52:35.943430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a337a3-01d6-4d1c-a2e8-417d1aa3b88a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:35.943755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a337a3-01d6-4d1c-a2e8-417d1aa3b88a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:35.944072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a337a3-01d6-4d1c-a2e8-417d1aa3b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:35.962516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f3a337a3-01d6-4d1c-a2e8-417d1aa3b88a None None] MFA Rules not processed for user `64bc77e79518405f8915783e7fee812b`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:35.963687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f3a337a3-01d6-4d1c-a2e8-417d1aa3b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:36.015803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1239/2425] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:36.027719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:36.029483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:36.043228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc194-8149-426a-9f6f-964b9f5129f3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:36.046764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:36.047438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.047755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.048036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.056242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:36.057660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0036054-4a08-42b0-adbd-6cffe9f94e79 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:36.065414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1187/2426] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:36.149214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44db2b-5aed-46de-a642-c59c69aadf55 None None] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.149609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44db2b-5aed-46de-a642-c59c69aadf55 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.150036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44db2b-5aed-46de-a642-c59c69aadf55 None None] PATH_INFO: `/` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.151101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1240/2427] 10.222.0.23 () {54 vars in 921 bytes} [Wed Jul 20 14:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 14:52:36.156966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6083f04-cd2e-4414-a10b-6633cc0f394f None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.157260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6083f04-cd2e-4414-a10b-6633cc0f394f None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.157544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6083f04-cd2e-4414-a10b-6633cc0f394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.176388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d6083f04-cd2e-4414-a10b-6633cc0f394f None None] MFA Rules not processed for user `54774acef6c54a06a81facfe13173568`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:36.177598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d6083f04-cd2e-4414-a10b-6633cc0f394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:36.191259 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1188/2428] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Jul 20 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:52:36.203923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44db2b-5aed-46de-a642-c59c69aadf55 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:36.217092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44db2b-5aed-46de-a642-c59c69aadf55 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:36.220801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:36.221482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.221791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.222077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.233470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:36.234842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:36.246120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1241/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:36.255532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd83aa-09c5-425e-9848-bdf718ec97d0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.255829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd83aa-09c5-425e-9848-bdf718ec97d0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.256114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd83aa-09c5-425e-9848-bdf718ec97d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.274518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-41cd83aa-09c5-425e-9848-bdf718ec97d0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:36.275754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-41cd83aa-09c5-425e-9848-bdf718ec97d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:36.284485 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1189/2430] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:36.302237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:36.316430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f8d4-aac4-4537-9579-67dea6833331 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:36.322326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:36.322975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:36.323261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:36.323573 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:36.332482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:36.334394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:36.345848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1242/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:40.108326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab6bf-7203-4f3d-9a7f-c9442999646c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:40.108816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab6bf-7203-4f3d-9a7f-c9442999646c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:40.108912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab6bf-7203-4f3d-9a7f-c9442999646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:40.126666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d49ab6bf-7203-4f3d-9a7f-c9442999646c None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:40.127833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d49ab6bf-7203-4f3d-9a7f-c9442999646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:40.135643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1190/2432] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:40.147531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:40.158729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82466a7-c5f1-455e-9b61-fe6afb549569 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:40.163762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:40.164423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:40.164721 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:40.165102 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:40.173115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:40.174690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:40.184848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1243/2433] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:52:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:52:40.474300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4256b-0062-4c74-a13b-db94f74bc289 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:40.474916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4256b-0062-4c74-a13b-db94f74bc289 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:40.475830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4256b-0062-4c74-a13b-db94f74bc289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:40.510816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1af4256b-0062-4c74-a13b-db94f74bc289 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:52:40.512501 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1af4256b-0062-4c74-a13b-db94f74bc289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:52:40.525857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1191/2434] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:52:40.541657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:52:40.554630 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:52:40.562154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed03d-0a7e-4080-8e84-1397b6480b70 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:52:40.568881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:52:40.569565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:52:40.569853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:52:40.570135 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:52:40.594146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:52:40.595940 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:52:40.615141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1244/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:52:50.503731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=20 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:52:50.605901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:02.197015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210332-c9d0-444b-a4ef-df68f2a57a39 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:02.197573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210332-c9d0-444b-a4ef-df68f2a57a39 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:02.197772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210332-c9d0-444b-a4ef-df68f2a57a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:02.217639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-18210332-c9d0-444b-a4ef-df68f2a57a39 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:53:02.218847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-18210332-c9d0-444b-a4ef-df68f2a57a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:02.226872 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1192/2436] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Jul 20 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:53:02.241886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:02.253942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd42d9-99b9-412d-b685-e30083199153 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:02.259955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:02.260501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:02.260618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:02.260888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:02.270421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:02.272086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:02.281647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1245/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:53:04.849566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c23b-5ae7-4cee-8de4-830099989148 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:04.850135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c23b-5ae7-4cee-8de4-830099989148 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:04.850135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c23b-5ae7-4cee-8de4-830099989148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:04.871389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ab57c23b-5ae7-4cee-8de4-830099989148 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:53:04.872884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ab57c23b-5ae7-4cee-8de4-830099989148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:04.880296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1193/2438] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:53:04.893402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:04.905985 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c31fe-1181-4db2-9ed0-0cef24a7b9b3 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:04.911000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:04.911680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:04.911971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:04.912252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:04.920876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:04.922467 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:04.930738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1246/2439] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:53:14.866009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:14.927364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=12 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:25.494632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:25.495187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:25.495187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:25.513239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] MFA Rules not processed for user `b917fb517461496885f5c5dfb6a0b207`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:53:25.514458 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:25.569740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1194/2440] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:53:34.566202 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:34.567717 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:34.585655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c724c-3ed9-4a9f-b03d-222facce10a7 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:34.590437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:34.591301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:34.591612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:34.591886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] PATH_INFO: `/v3/users/bf26b8412da548bd98a461445b3bd09c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:34.593312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf26b8412da548bd98a461445b3bd09c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:34.595213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:34.646594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf26b8412da548bd98a461445b3bd09c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.656312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf26b8412da548bd98a461445b3bd09c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.668484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf26b8412da548bd98a461445b3bd09c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.675405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf26b8412da548bd98a461445b3bd09c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.676084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf26b8412da548bd98a461445b3bd09c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.681904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1247/2441] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:53:34 2022] DELETE /identity/v3/users/bf26b8412da548bd98a461445b3bd09c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:53:34.857195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:34.868813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dad11e-e8fa-4014-bf66-6b35b39467f8 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:34.928539 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:34.929408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:34.929696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:34.929974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] PATH_INFO: `/v3/projects/8bf38006ccd94f05bf78186f2dbec022` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:34.931200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf38006ccd94f05bf78186f2dbec022)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:34.933131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:34.979673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf38006ccd94f05bf78186f2dbec022', 'request_id': 'req-db80b5b5-dd80-4611-9bd1-8335644a30fd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.987357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf38006ccd94f05bf78186f2dbec022', 'request_id': 'req-db80b5b5-dd80-4611-9bd1-8335644a30fd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:34.992965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf38006ccd94f05bf78186f2dbec022', 'request_id': 'req-db80b5b5-dd80-4611-9bd1-8335644a30fd'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:35.004325 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] The token cache is being invalidate because project 8bf38006ccd94f05bf78186f2dbec022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:53:35.004680 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:35.005353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:53:35.006871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1195/2442] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:53:34 2022] DELETE /identity/v3/projects/8bf38006ccd94f05bf78186f2dbec022 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:53:41.197679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:41.199077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:41.256465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70704fc9-f88b-42b8-b15f-74e5014e0f61 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:41.305208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:41.305855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:41.306141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:41.306420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:41.308393 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:41.351341 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:41.382189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:41.383580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f2470-60dd-4ba6-be04-3e479ae71154 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:41.394566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1248/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:53:42.797708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:42.799234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:42.841783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:42.862165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80b5b5-dd80-4611-9bd1-8335644a30fd admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:42.865831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:42.866487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:42.866777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:42.867068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:42.868897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:42.882673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:42.884137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:42.895055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1196/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:53:51.389701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=14 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:52.890246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=10 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:53:53.933989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:53.935203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:53.935311 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:53.952308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] MFA Rules not processed for user `5d0090359d7c46038b82bbb903abab93`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:53:53.953511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.007835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1249/2445] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:53:54.311632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:54.320279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4bebf-6c79-435a-ab47-9bf0ebd436cc service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:54.323881 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:54.324521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:54.324809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:54.325116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:54.326848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.336302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:54.337717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:54.346338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1197/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:53:54.645373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:54.646871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.664581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4c427-d178-4a46-ae8e-1dc37dd5c0a9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:54.664969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:53:54.666462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.670125 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:54.670777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:54.671074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:54.671358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:54.673373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.685522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:54.687329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:54.697860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1250/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:53:54.739190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef8d6a-7a31-48fa-b910-53c648cfaa3d service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:53:54.744340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:53:54.745001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:53:54.745295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:53:54.745591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:53:54.747931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:53:54.759941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:53:54.761578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:53:54.774609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1198/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:04.693163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=31 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:04.768013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=38 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:07.798603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:07.800241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:07.812994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142fd38-6716-4dbf-9dc0-e0459c5bea07 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:07.816749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:07.817409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:07.817696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:07.817973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:07.819832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:07.830437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:07.831827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:07.840055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1251/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:13.712272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:13.713695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:13.730571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7af8-a9c1-42fc-9eb1-38fcce88774d service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:13.736542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:13.737187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:13.737470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:13.737747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:13.739504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:13.797474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:13.799075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e8acf-61f2-465a-87fd-7df37d499601 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:13.808298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1199/2450] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:17.836512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=6 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:18.089494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:18.105787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba54819-89f5-4505-b1f4-f6e2892cf369 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:18.114059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:18.114719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:18.115004 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:18.115283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:18.117545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:18.133810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:18.135967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:18.164564 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1252/2451] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:20.785566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:20.786092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:20.786198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:20.804292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] MFA Rules not processed for user `f435520f0ee748f1bac962c6b8051f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:20.805497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:20.813043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1200/2452] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:26.640789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:26.642221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:26.653832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc28671-42fd-4d14-ad54-19f3fc4aa678 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:26.657395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:26.658030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:26.658314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:26.658619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:26.660358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:26.719723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:26.721164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:26.730330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1253/2453] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:30.798971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=31 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:31.660323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:31.676054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed7fd-2e89-483b-a81e-d4183bf20cb0 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:31.681725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:31.682375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:31.682657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:31.682934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:31.684750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:31.697552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:31.699128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:31.711370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1201/2454] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:33.261238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:33.282499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589aacd-892a-42b9-9681-5f8375d3774d service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:33.289237 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:33.290297 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:33.290567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:33.291033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:33.293251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:33.307162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:33.309203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:33.322278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1254/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:41.706311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:43.316760 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=40 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:46.542034 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:46.551934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6baad-e72d-4dba-98c0-d3d8c2ad39cc service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:46.555403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:46.556065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:46.556344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:46.556616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:46.558398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:46.619440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:46.620897 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:46.631367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1202/2456] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:49.657650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:49.659191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:49.673545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49407f31-73b7-4014-852b-ea788c6947c6 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:49.678644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:49.680453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:49.680453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:49.680453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] PATH_INFO: `/v3/users/b917fb517461496885f5c5dfb6a0b207` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:49.681512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b917fb517461496885f5c5dfb6a0b207)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:49.683437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:49.738294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b917fb517461496885f5c5dfb6a0b207'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:49.746595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b917fb517461496885f5c5dfb6a0b207'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:49.759155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b917fb517461496885f5c5dfb6a0b207'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:49.766082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b917fb517461496885f5c5dfb6a0b207'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:49.766815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1e9ccc7e-c83f-4add-89f8-223b2c98b20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b917fb517461496885f5c5dfb6a0b207'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:49.773197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1255/2457] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:54:49 2022] DELETE /identity/v3/users/b917fb517461496885f5c5dfb6a0b207 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:49.951691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:49.961985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abcf68-e7d9-40da-a108-c59d57b15de3 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.027810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.029004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.029425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.029838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] PATH_INFO: `/v3/projects/e264ecc42d2f4deaae8b19484cd0e153` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.031620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e264ecc42d2f4deaae8b19484cd0e153)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.035408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.091979 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e264ecc42d2f4deaae8b19484cd0e153', 'request_id': 'req-694a5920-2372-4d09-81cf-e2a54fcdc696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:50.100179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e264ecc42d2f4deaae8b19484cd0e153', 'request_id': 'req-694a5920-2372-4d09-81cf-e2a54fcdc696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:50.105762 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e264ecc42d2f4deaae8b19484cd0e153', 'request_id': 'req-694a5920-2372-4d09-81cf-e2a54fcdc696'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:50.117395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] The token cache is being invalidate because project e264ecc42d2f4deaae8b19484cd0e153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:54:50.117689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:50.118327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-694a5920-2372-4d09-81cf-e2a54fcdc696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:50.119907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1203/2458] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:54:49 2022] DELETE /identity/v3/projects/e264ecc42d2f4deaae8b19484cd0e153 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:50.124852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.125150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.125441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.144150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:50.145366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:50.205945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1256/2459] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:50.213602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.213901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.214189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.233142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:50.234348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:50.242313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1204/2460] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:50.246428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.256037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e319c-38fe-4dc2-a195-3c50b26f3b3e None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.260632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.261287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.261569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.261848 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.262586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:54:50.262895 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.264535 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.276671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1257/2461] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:54:50.280980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.291140 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293147-8e55-4c74-8594-2f7aab743258 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.295794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.296448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.296768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.297017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.297725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.299689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.313417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:50.327302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1205/2462] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:50.332051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.342021 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dff3de-d311-48cb-a07f-39280787958c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.399866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.400584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.400871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.401151 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.401857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.403883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.411017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:50.426120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1258/2463] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:50.430293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.440628 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d79660-502e-4a1a-8fdb-6bb4bff601bc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.445271 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.445936 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.446224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.446504 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.447235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.448885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.459772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1206/2464] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:50.463707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.474547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25b9a-5ae5-41d5-809b-80e6cf172d9b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.479226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.479947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.480240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.480519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.481255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.482856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e96c-4a8d-4e23-bc03-b2b81cd3ef7f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.493583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1259/2465] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:50.497877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.508574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3925f03-6fe4-4fb6-9cc6-605474ada2e7 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.513419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.514303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.514595 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.514879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] PATH_INFO: `/v3/projects/06ae702e41a644f79ace6a8d3c41872b/users/7997fecc348e4fbbb8a16cc8a98c6b5b/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.531286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ae702e41a644f79ace6a8d3c41872b, user_id=7997fecc348e4fbbb8a16cc8a98c6b5b, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.533982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.546830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1207/2466] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:50 2022] PUT /identity/v3/projects/06ae702e41a644f79ace6a8d3c41872b/users/7997fecc348e4fbbb8a16cc8a98c6b5b/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:50.557539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.557837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.558120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.586527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] MFA Rules not processed for user `7997fecc348e4fbbb8a16cc8a98c6b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:50.587794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:50.652455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1260/2467] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:50.656975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.726559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32dfa-c14f-46d1-91e3-9330c002b685 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.731317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.732020 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.732309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.732592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.733313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.735258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.767733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1208/2468] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:50.771610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.782814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae26937-dfce-4cd2-981b-48738933fdc7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.840779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.841456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.841738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.842013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.842732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.844984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.866132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1261/2469] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:54:50 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:50.870026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.882821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196be293-9bdd-4151-b5a1-95fac4c1e316 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.887548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.888289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.888499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.888777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.889508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.891104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.901931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1209/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:54:50.909040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.919154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d828-9527-4ad4-914c-8ffb15f59287 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:50.924272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:50.925147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:50.925427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:50.925700 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] PATH_INFO: `/v3/projects/c7dfa74cf4734324946db45e19289895/users/52df177459ca4929bf48c5481e2aad23/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:50.940841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dfa74cf4734324946db45e19289895, user_id=52df177459ca4929bf48c5481e2aad23, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:50.943553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:50.956927 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1262/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:50 2022] PUT /identity/v3/projects/c7dfa74cf4734324946db45e19289895/users/52df177459ca4929bf48c5481e2aad23/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:50.961323 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:50.971804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaed5f-9883-4c51-8d9c-4d6e8b0c5e17 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:51.029527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:51.030196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.030480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.030758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.031515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:51.033158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503111e5-165a-4f5a-bb66-f1978c6d3087 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:51.042754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1210/2472] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:51.047007 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:51.060321 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eca093-6c90-408c-89c1-2945b6241087 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:51.062963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:51.064437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.064816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.064816 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] PATH_INFO: `/v3/projects/c7dfa74cf4734324946db45e19289895/users/52df177459ca4929bf48c5481e2aad23/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.066956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dfa74cf4734324946db45e19289895, user_id=52df177459ca4929bf48c5481e2aad23, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:51.071557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:51.085813 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1263/2473] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:51 2022] PUT /identity/v3/projects/c7dfa74cf4734324946db45e19289895/users/52df177459ca4929bf48c5481e2aad23/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:51.096622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.096911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.097190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.124185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] MFA Rules not processed for user `52df177459ca4929bf48c5481e2aad23`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:51.125478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:51.145538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:51.195575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1211/2474] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:51.206084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:51.207823 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:51.230502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:51.266521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0b4e0-be2f-4c21-b307-303eca362776 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:51.270206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:51.270854 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.271141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.271422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.280645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:51.282094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1b4f-ad10-4f06-b49c-589b6a59c59e service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:51.292479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1264/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:51.421301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:51.482982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983acf7-e45b-4afb-bca1-1bf517222ed2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:51.488293 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:51.489250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.489456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.489739 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] PATH_INFO: `/v3/users/7997fecc348e4fbbb8a16cc8a98c6b5b` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.490942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7997fecc348e4fbbb8a16cc8a98c6b5b)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:51.492886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:51.544210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7997fecc348e4fbbb8a16cc8a98c6b5b'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:51.552440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7997fecc348e4fbbb8a16cc8a98c6b5b'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:51.564565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7997fecc348e4fbbb8a16cc8a98c6b5b'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:51.565221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7997fecc348e4fbbb8a16cc8a98c6b5b'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:51.572158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7997fecc348e4fbbb8a16cc8a98c6b5b'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:51.578046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1212/2476] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:54:51 2022] DELETE /identity/v3/users/7997fecc348e4fbbb8a16cc8a98c6b5b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:51.582906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.583196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.583512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.602364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:51.603614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:51.663878 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1265/2477] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:51.673857 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:51.675261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:51.716440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:51.735880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3300-f474-4c9e-9a41-02dfa2e8e34f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:51.739615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:51.740266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:51.740552 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:51.740856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:51.750003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:51.751517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:51.761022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1213/2478] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:52.280738 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:52.282236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:52.294513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f517-585f-4b0b-81a1-5afc3112dbb1 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:52.299369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:52.300302 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:52.300595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:52.300877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] PATH_INFO: `/v3/projects/06ae702e41a644f79ace6a8d3c41872b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:52.302097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ae702e41a644f79ace6a8d3c41872b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:52.304077 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:52.356960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ae702e41a644f79ace6a8d3c41872b', 'request_id': 'req-6be80c80-e843-442c-8006-8ae9aa190ef6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.364964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ae702e41a644f79ace6a8d3c41872b', 'request_id': 'req-6be80c80-e843-442c-8006-8ae9aa190ef6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.371577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ae702e41a644f79ace6a8d3c41872b', 'request_id': 'req-6be80c80-e843-442c-8006-8ae9aa190ef6'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.383215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] The token cache is being invalidate because project 06ae702e41a644f79ace6a8d3c41872b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:54:52.383543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.384189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.385734 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1266/2479] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:54:52 2022] DELETE /identity/v3/projects/06ae702e41a644f79ace6a8d3c41872b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:52.389837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:52.400068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005fead-2d2a-4b6b-bf1e-79c4e1b4254f service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:52.455627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:52.456518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:52.456807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:52.457086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] PATH_INFO: `/v3/users/52df177459ca4929bf48c5481e2aad23` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:52.458709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52df177459ca4929bf48c5481e2aad23)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:52.460670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:52.509407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52df177459ca4929bf48c5481e2aad23'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.517798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52df177459ca4929bf48c5481e2aad23'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.530419 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52df177459ca4929bf48c5481e2aad23'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.531119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52df177459ca4929bf48c5481e2aad23'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.538788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13711f8f-97e9-4f23-ab1c-dda442604b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52df177459ca4929bf48c5481e2aad23'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.544919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1214/2480] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:54:52 2022] DELETE /identity/v3/users/52df177459ca4929bf48c5481e2aad23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:52.824916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:52.826362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:52.839711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be80c80-e843-442c-8006-8ae9aa190ef6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:52.884686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:52.899592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:52.900470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:52.900751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:52.901025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] PATH_INFO: `/v3/projects/c7dfa74cf4734324946db45e19289895` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:52.902246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7dfa74cf4734324946db45e19289895)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:52.904201 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:52.950904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7dfa74cf4734324946db45e19289895', 'request_id': 'req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.958305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7dfa74cf4734324946db45e19289895', 'request_id': 'req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.964097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7dfa74cf4734324946db45e19289895', 'request_id': 'req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.975828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] The token cache is being invalidate because project c7dfa74cf4734324946db45e19289895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:54:52.976123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.976761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-4d7f74ee-5eb8-43b6-9919-a29604bdfe4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:54:52.978305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1267/2481] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:54:52 2022] DELETE /identity/v3/projects/c7dfa74cf4734324946db45e19289895 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:52.983218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:52.983549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:52.983833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.004154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:53.005396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:53.058803 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:53.070761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1215/2482] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:53.078505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.078793 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.079073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.098488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:53.099899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:53.108205 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1268/2483] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:53.113224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.123624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce170d52-4f76-4aae-979f-ca618bded84b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.128383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.129039 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.129345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.129714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.130545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:54:53.130852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.132479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.144433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1216/2484] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:54:53.148742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.158761 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872ef17-1797-411a-a6e6-61f1f492d3e6 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.163396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.164076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.164367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.164645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.165365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.167249 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.192833 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1269/2485] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:53.197137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.207607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea90d54-5e42-4f77-92de-dc6d4af9ec06 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.263186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.263882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.264169 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.264447 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.265180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.267624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.287721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1217/2486] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:53.291840 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.302534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e649e-b753-40c0-9f62-5a802413066d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.307080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.307770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.308056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.308326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.309136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.310883 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.321611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1270/2487] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:53.325522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.336010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d5f1e-5fe7-4d22-9172-5d88b9df15c6 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.340731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.341382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.341666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.341942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.342665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.344542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68e213-0b04-4382-a54d-d62d2674bdc8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.355210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1218/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:53.359427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.369308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179f76-6321-4c68-8a25-b0af5c53e77b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.373899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.374776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.375068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.375358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] PATH_INFO: `/v3/projects/c401c4ba2515467d89859025e9e8c124/users/b7b636d328cb4fa0a4f3b087d1ef600c/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.391408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c401c4ba2515467d89859025e9e8c124, user_id=b7b636d328cb4fa0a4f3b087d1ef600c, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.394611 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.408765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1271/2489] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:53 2022] PUT /identity/v3/projects/c401c4ba2515467d89859025e9e8c124/users/b7b636d328cb4fa0a4f3b087d1ef600c/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:53.425902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.426483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.426483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.453309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] MFA Rules not processed for user `b7b636d328cb4fa0a4f3b087d1ef600c`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:53.455029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:53.522312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1219/2490] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:54:53.526828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.588808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cfbd6-1570-4716-b029-b83f89d6f937 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.593383 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.594270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.594550 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.594825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.595531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.597436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.615891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:53.627361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1272/2491] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:53.628787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.639736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9c240-c25e-4aa9-82e7-f2d351764421 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.687398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:54:53.699104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.700221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.700221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.700625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.701624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.704000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.728105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1220/2492] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:54:53.732040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.742591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58257c-77f9-4404-b305-dfe027beed54 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.747258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.747957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.748350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.748643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.749379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.750981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.762027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1273/2493] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:53.766094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.776837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dffc8-5044-40bb-b3a2-1a35d25c6f87 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.781706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.782586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.782874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.783151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] PATH_INFO: `/v3/projects/87173302abc84c3b836c3faca27e2904/users/d4b9aa7fa9b8442f9f4be1ad8be67a71/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.798044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=87173302abc84c3b836c3faca27e2904, user_id=d4b9aa7fa9b8442f9f4be1ad8be67a71, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.800749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.814295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1221/2494] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:53 2022] PUT /identity/v3/projects/87173302abc84c3b836c3faca27e2904/users/d4b9aa7fa9b8442f9f4be1ad8be67a71/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:53.818248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.828566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c97a5-a714-4334-8010-49a0220df5a8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.886485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.887061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.887346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.887652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.888378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.889974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79fb22-0664-49a3-9f81-83bb34f264a8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.900206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1274/2495] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:54:53.904557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:53.915195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f818b5-1b2f-499e-b047-9113ecbb57cf admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:53.919911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:53.920833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.921116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.921391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] PATH_INFO: `/v3/projects/87173302abc84c3b836c3faca27e2904/users/d4b9aa7fa9b8442f9f4be1ad8be67a71/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.924038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87173302abc84c3b836c3faca27e2904, user_id=d4b9aa7fa9b8442f9f4be1ad8be67a71, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:53.926746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:53.936955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1222/2496] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:54:53 2022] PUT /identity/v3/projects/87173302abc84c3b836c3faca27e2904/users/d4b9aa7fa9b8442f9f4be1ad8be67a71/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:54:53.948033 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:53.948334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:53.948646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:53.975372 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] MFA Rules not processed for user `d4b9aa7fa9b8442f9f4be1ad8be67a71`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:54:53.976617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:54.044577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1275/2497] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:54:54.056182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:54.057924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:54:54.115663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757df5c-2f0a-4725-84b0-6ff30ec17c27 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:54.119372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:54.120049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:54.120340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:54.120622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:54.130996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:54.132524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:54.142340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1223/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:54:54.215347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:54:54.225891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa45c-f6e7-48ea-9b33-31359e551ec5 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:54:54.229465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:54:54.230095 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:54:54.230377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:54:54.230651 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:54:54.287745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:54:54.289178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c3a9b-6ab3-44cc-8bdd-862e5e480204 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:54:54.298137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1276/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:01.021109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:01.083228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ff3c-db1a-484f-8aa8-1e78445bd10b service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:01.087991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:01.088864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:01.089148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:01.089425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] PATH_INFO: `/v3/users/b7b636d328cb4fa0a4f3b087d1ef600c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:01.090630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b636d328cb4fa0a4f3b087d1ef600c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:01.092597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:01.142849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b636d328cb4fa0a4f3b087d1ef600c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.145345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:01.150740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b636d328cb4fa0a4f3b087d1ef600c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.164837 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b636d328cb4fa0a4f3b087d1ef600c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.165563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b636d328cb4fa0a4f3b087d1ef600c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.172578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b636d328cb4fa0a4f3b087d1ef600c'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.179382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1224/2500] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:01 2022] DELETE /identity/v3/users/b7b636d328cb4fa0a4f3b087d1ef600c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:01.184009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:01.184488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:01.186708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:01.207728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:01.215595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:01.216827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:01.284073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1277/2501] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:01.294745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:01.296384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:01.354554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb68b-9e09-4e87-938c-67e208e25b11 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:01.358228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:01.358873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:01.359156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:01.359436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:01.369502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:01.371021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:01.381194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1225/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:01.685346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:01.688026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:01.701515 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0d8a-89dd-40c9-af08-1f9f6e4c12e1 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:01.707811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:01.708703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:01.708984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:01.709261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] PATH_INFO: `/v3/projects/c401c4ba2515467d89859025e9e8c124` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:01.712730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c401c4ba2515467d89859025e9e8c124)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:01.714844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:01.769147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c401c4ba2515467d89859025e9e8c124', 'request_id': 'req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.778961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c401c4ba2515467d89859025e9e8c124', 'request_id': 'req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.785632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c401c4ba2515467d89859025e9e8c124', 'request_id': 'req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.798144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] The token cache is being invalidate because project c401c4ba2515467d89859025e9e8c124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:01.798432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.799087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.800876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1278/2503] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:01 2022] DELETE /identity/v3/projects/c401c4ba2515467d89859025e9e8c124 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:55:01.806134 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:01.820061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdf45-3162-4de9-8f98-54251b1608ac service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:01.880309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:01.881198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:01.881489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:01.881777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] PATH_INFO: `/v3/users/d4b9aa7fa9b8442f9f4be1ad8be67a71` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:01.883015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b9aa7fa9b8442f9f4be1ad8be67a71)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:01.885101 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:01.936684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b9aa7fa9b8442f9f4be1ad8be67a71'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.944853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b9aa7fa9b8442f9f4be1ad8be67a71'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.957753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b9aa7fa9b8442f9f4be1ad8be67a71'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.958454 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b9aa7fa9b8442f9f4be1ad8be67a71'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.960368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:01.968225 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-f8c36158-97f3-401a-a95f-544d9c034009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b9aa7fa9b8442f9f4be1ad8be67a71'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:01.976622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1226/2504] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:01 2022] DELETE /identity/v3/users/d4b9aa7fa9b8442f9f4be1ad8be67a71 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:02.256073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.258303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:02.275569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58ba3c-32d7-41cc-8abb-ce1a86e803f1 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.336731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.337601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.337929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.338241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] PATH_INFO: `/v3/projects/87173302abc84c3b836c3faca27e2904` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.339712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87173302abc84c3b836c3faca27e2904)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.341860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.377468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:02.391647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87173302abc84c3b836c3faca27e2904', 'request_id': 'req-2ecbd869-6a3a-45d7-8944-f14436f482bd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:02.398800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87173302abc84c3b836c3faca27e2904', 'request_id': 'req-2ecbd869-6a3a-45d7-8944-f14436f482bd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:02.404634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87173302abc84c3b836c3faca27e2904', 'request_id': 'req-2ecbd869-6a3a-45d7-8944-f14436f482bd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:02.416107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] The token cache is being invalidate because project 87173302abc84c3b836c3faca27e2904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:02.416394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:02.417026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2ecbd869-6a3a-45d7-8944-f14436f482bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:02.418565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1279/2505] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:02 2022] DELETE /identity/v3/projects/87173302abc84c3b836c3faca27e2904 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:02.423431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.423942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.424053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.443704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:02.444971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:02.507348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1227/2506] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:02.516444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.516740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.517103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.538149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:02.539498 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:02.547853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1280/2507] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:02.552631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.562505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b5fe-3d0d-4a86-be13-abf238984331 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.567053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.567724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.568009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.568288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.569516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:55:02.569829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.571420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.582929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1228/2508] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:55:02.588243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.597972 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac762142-842e-44ee-9db2-5f59c6b9b7ae None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.602921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.603622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.603908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.604184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.604920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.606814 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.642177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1281/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:02.647921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.663119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbb21c-71f8-42b1-a20c-62b6fb58f0a4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.719814 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.720498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.720785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.721065 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.721771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.723712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.743760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1229/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:55:02.748130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.759333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de945376-2c98-426d-b2a0-6df676191ce0 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.763990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.764646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.764934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.765214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.765952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.767608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.778303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1282/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:02.782222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.792080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7215d8-8e2e-4734-b8e2-017ecd504274 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.796858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.797556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.797846 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.798158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.798898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.800577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24819e6e-2aba-4d76-adc4-5b8e969ed4dc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.811186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1230/2512] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:02.815652 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:02.826508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8168b-1716-441c-8bdb-c211a6dd225c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:02.831153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:02.832094 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.832377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.832656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] PATH_INFO: `/v3/projects/bb2c41bcac584a779a5460b2f2be8fca/users/af9a7ebaf8334d5080a656d82a451509/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.847672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2c41bcac584a779a5460b2f2be8fca, user_id=af9a7ebaf8334d5080a656d82a451509, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:02.850606 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:02.868300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1283/2513] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:02 2022] PUT /identity/v3/projects/bb2c41bcac584a779a5460b2f2be8fca/users/af9a7ebaf8334d5080a656d82a451509/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:02.879043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:02.879339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:02.879649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:02.907289 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] MFA Rules not processed for user `af9a7ebaf8334d5080a656d82a451509`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:02.908538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:02.962085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:02.983976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1231/2514] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:02.988477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.050983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73003a-b5ca-4ac7-a522-8f32289497c7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.057440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.058110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.058401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.058681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.059380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.061357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.087684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1284/2515] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:55:02 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:03.091691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.102938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f472cf7-0ade-456f-80c4-f574a05231f2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.159144 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.159849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.160139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.160420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.161130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.163569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.183469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1232/2516] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:55:03 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:03.187763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.198744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0af98-2f46-46bc-9439-4bfe9ce42766 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.203406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.204103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.204388 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.204665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.205485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.207603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.219233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1285/2517] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:03.223381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.234056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311dba-92dc-4c45-980c-498a61ea6408 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.238827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.239782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.240071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.240355 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] PATH_INFO: `/v3/projects/114415bceb364588b6ecf54fcc057ff9/users/899a86e80e244953847ec84cc7df7886/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.255503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114415bceb364588b6ecf54fcc057ff9, user_id=899a86e80e244953847ec84cc7df7886, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.258660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.271507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1233/2518] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:03 2022] PUT /identity/v3/projects/114415bceb364588b6ecf54fcc057ff9/users/899a86e80e244953847ec84cc7df7886/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:55:03.276072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.286309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19073-f9a7-4250-b6e4-6909df10854c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.319016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:03.351054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.351764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.352047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.352320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.353044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.354629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e49d-f48f-4530-ab04-30861358d222 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.364399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1286/2519] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:03.368714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.378923 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538245-eb76-4e61-b8f6-7d935651d271 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.384072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.384950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.385234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.385513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] PATH_INFO: `/v3/projects/114415bceb364588b6ecf54fcc057ff9/users/899a86e80e244953847ec84cc7df7886/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.387535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=114415bceb364588b6ecf54fcc057ff9, user_id=899a86e80e244953847ec84cc7df7886, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.390172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.401380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1234/2520] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:03 2022] PUT /identity/v3/projects/114415bceb364588b6ecf54fcc057ff9/users/899a86e80e244953847ec84cc7df7886/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:03.411574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.411874 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.412190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.439670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] MFA Rules not processed for user `899a86e80e244953847ec84cc7df7886`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:03.441029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:03.517837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1287/2521] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:03.530435 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.532810 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:03.590593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7bff-3d05-4332-a496-7c0afa1a3e9b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.594569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.595210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.595521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.595807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.604982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.606443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.622653 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1235/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:03.675186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:03.676666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:03.689819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3410e-791d-48ca-b9e9-040d8c4c67f5 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:03.694159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:03.695618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:03.695898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:03.696334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:03.760407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:03.761865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd1062-a78b-45e2-bebb-ea8ddaafc10b service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:03.771221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1288/2523] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:07.112334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:07.156627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:07.182399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a78d-9dcb-4e8a-83b1-4b7110dfa1c5 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:07.187048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:07.188217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:07.188359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:07.188524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] PATH_INFO: `/v3/users/af9a7ebaf8334d5080a656d82a451509` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:07.191200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9a7ebaf8334d5080a656d82a451509)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:07.191813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:07.243226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9a7ebaf8334d5080a656d82a451509'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.253563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9a7ebaf8334d5080a656d82a451509'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.265991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9a7ebaf8334d5080a656d82a451509'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.266671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9a7ebaf8334d5080a656d82a451509'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.274155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9a7ebaf8334d5080a656d82a451509'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.280071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1236/2524] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:07 2022] DELETE /identity/v3/users/af9a7ebaf8334d5080a656d82a451509 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:07.284729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:07.285189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:07.285308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:07.302572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:07.303789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:07.350022 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:07.365207 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1289/2525] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:07.374841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:07.376278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:07.433783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708c446-b1a3-476a-861c-38a43cb6a8ee admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:07.437430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:07.438079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:07.438364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:07.438642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:07.447901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:07.449344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:07.459046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1237/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:07.745194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:07.746785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:07.761724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa1a7-a151-4c8c-91fd-c0ed1bbdf961 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:07.771008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:07.772924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:07.773285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:07.773697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] PATH_INFO: `/v3/projects/bb2c41bcac584a779a5460b2f2be8fca` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:07.775006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2c41bcac584a779a5460b2f2be8fca)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:07.777002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:07.824945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2c41bcac584a779a5460b2f2be8fca', 'request_id': 'req-06a165d9-6493-4ad8-822c-7758bc2b5b4d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.832801 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2c41bcac584a779a5460b2f2be8fca', 'request_id': 'req-06a165d9-6493-4ad8-822c-7758bc2b5b4d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.839787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2c41bcac584a779a5460b2f2be8fca', 'request_id': 'req-06a165d9-6493-4ad8-822c-7758bc2b5b4d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.850956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] The token cache is being invalidate because project bb2c41bcac584a779a5460b2f2be8fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:07.851233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.851892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.853447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1290/2527] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:07 2022] DELETE /identity/v3/projects/bb2c41bcac584a779a5460b2f2be8fca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:07.857408 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:07.866999 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef26dd-ee5d-42e6-9993-7f472dfa7936 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:07.928119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:07.929021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:07.929299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:07.929585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] PATH_INFO: `/v3/users/899a86e80e244953847ec84cc7df7886` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:07.930765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=899a86e80e244953847ec84cc7df7886)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:07.932740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:07.934995 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:07.979761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899a86e80e244953847ec84cc7df7886'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.987093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899a86e80e244953847ec84cc7df7886'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:07.999536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899a86e80e244953847ec84cc7df7886'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.000183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899a86e80e244953847ec84cc7df7886'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.007716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2c6fc89c-1ca8-4e5d-aea8-8e27b13768ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899a86e80e244953847ec84cc7df7886'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.013740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1238/2528] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:07 2022] DELETE /identity/v3/users/899a86e80e244953847ec84cc7df7886 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:08.294134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.295682 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:08.312076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a165d9-6493-4ad8-822c-7758bc2b5b4d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.370278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.371065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.371347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.371722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] PATH_INFO: `/v3/projects/114415bceb364588b6ecf54fcc057ff9` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.372909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=114415bceb364588b6ecf54fcc057ff9)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.374842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.421756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114415bceb364588b6ecf54fcc057ff9', 'request_id': 'req-dfe4482e-99de-4cab-b721-2d14a5b286eb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.429957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114415bceb364588b6ecf54fcc057ff9', 'request_id': 'req-dfe4482e-99de-4cab-b721-2d14a5b286eb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.435781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114415bceb364588b6ecf54fcc057ff9', 'request_id': 'req-dfe4482e-99de-4cab-b721-2d14a5b286eb'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.446783 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] The token cache is being invalidate because project 114415bceb364588b6ecf54fcc057ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:08.447076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.447765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dfe4482e-99de-4cab-b721-2d14a5b286eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:08.449316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1291/2529] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:08 2022] DELETE /identity/v3/projects/114415bceb364588b6ecf54fcc057ff9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:08.454234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.454723 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.454820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.473123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:08.474335 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:08.536529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1239/2530] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:08.544766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.545053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.545332 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.552802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:08.566000 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:08.567220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:08.575614 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1292/2531] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:08.579832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.589668 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e122fb-9160-4116-88ae-496681e264c9 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.594548 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.595200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.595510 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.595788 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.596521 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:55:08.596827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.598430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.610775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1240/2532] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:55:08.614971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.625030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dfbfd-1e9f-4d88-96e1-e13abe9cc8f8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.629743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.630397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.630684 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.630965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.631707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.633673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.658794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1293/2533] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:08.663372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.673279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dce9d-90da-4964-acb3-c340fae8e05d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.730561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.731237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.731678 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.731963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.732679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.734570 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.749069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:08.756417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1241/2534] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:55:08.760469 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.770912 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7ac91-0843-4488-a64f-1dd5d9dadf45 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.776163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.776825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.777134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.777412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.778143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.779779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.790818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1294/2535] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:08.796148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.806370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8f76-fd96-4c34-a3c1-6a8871bad576 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.811070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.811767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.812058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.812338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.813068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.814671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bec19-6e95-4bc4-b5da-62f4cff62c01 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.824931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1242/2536] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:08.829378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:08.840045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae32d52-38a3-45a5-b28c-259cbcd54412 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:08.844934 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:08.845812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.846098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.846378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] PATH_INFO: `/v3/projects/7fd80d911b7842338f9be85d61cfe861/users/42b5cb5dd85f4f1f88df454c36debcde/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.861450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd80d911b7842338f9be85d61cfe861, user_id=42b5cb5dd85f4f1f88df454c36debcde, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:08.864147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:08.876933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1295/2537] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:08 2022] PUT /identity/v3/projects/7fd80d911b7842338f9be85d61cfe861/users/42b5cb5dd85f4f1f88df454c36debcde/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:08.887357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:08.887717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:08.888027 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:08.923422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] MFA Rules not processed for user `42b5cb5dd85f4f1f88df454c36debcde`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:08.924679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:08.989347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1243/2538] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:08.993880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.054881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24fd75-4b83-49a7-be18-1aaf126be80c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.059650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.060312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.060607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.060889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.061595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.063589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.089741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1296/2539] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:55:08 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:09.093489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.104998 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aecaa4-451e-4e5c-a4f6-e7fe20106a2c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.161213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.161805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.162093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.162375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.163067 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.165040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.184344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1244/2540] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:55:09 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:55:09.188382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.200619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65d43-9c05-48a7-9c0e-97299c36e38d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.206079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.206751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.207069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.207347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.208140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.210338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.221500 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1297/2541] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:09.225753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.236013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3dc4-af3e-434d-aacf-6a8e02fa7b5e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.240655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.241533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.241820 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.242099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] PATH_INFO: `/v3/projects/2fd34d41a98a492fb8d0ad308a04f809/users/deb10f0177374b28ac0070595d658b48/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.257139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd34d41a98a492fb8d0ad308a04f809, user_id=deb10f0177374b28ac0070595d658b48, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.259811 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.273933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1245/2542] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:09 2022] PUT /identity/v3/projects/2fd34d41a98a492fb8d0ad308a04f809/users/deb10f0177374b28ac0070595d658b48/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:09.277966 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.288401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615993-7aff-48e5-b0a0-ef4c74fecd9a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.345339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.346013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.346298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.346578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.347304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.348983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cbbf4-fff0-471e-b0df-547b62dadf16 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.358776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1298/2543] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:09.363001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.373120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2908d-fdaf-4b51-93b0-23470af18b04 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.377808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.378681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.378970 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.379243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] PATH_INFO: `/v3/projects/2fd34d41a98a492fb8d0ad308a04f809/users/deb10f0177374b28ac0070595d658b48/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.383606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd34d41a98a492fb8d0ad308a04f809, user_id=deb10f0177374b28ac0070595d658b48, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.386248 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.396888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1246/2544] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:09 2022] PUT /identity/v3/projects/2fd34d41a98a492fb8d0ad308a04f809/users/deb10f0177374b28ac0070595d658b48/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:09.408817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.409108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.409396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.429181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:09.437444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] MFA Rules not processed for user `deb10f0177374b28ac0070595d658b48`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:09.438906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:09.510489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1299/2545] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:09.521632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:09.523395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:09.555871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:09.583327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe6024-5f2b-45d9-a8ab-37f59ec9b142 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:09.587377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:09.588139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:09.588429 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:09.588741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:09.598287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:09.599759 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b1df-4ebc-4801-a9a6-f53ac2601dda service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:09.609359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1247/2546] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:10.154536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:10.217386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250fa9-51f7-4d15-807d-0071002275fa None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:10.222170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:10.223030 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:10.223317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:10.223629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] PATH_INFO: `/v3/users/42b5cb5dd85f4f1f88df454c36debcde` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:10.224868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b5cb5dd85f4f1f88df454c36debcde)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:10.226970 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:10.272379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b5cb5dd85f4f1f88df454c36debcde'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.279668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b5cb5dd85f4f1f88df454c36debcde'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.291523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b5cb5dd85f4f1f88df454c36debcde'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.298269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b5cb5dd85f4f1f88df454c36debcde'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.298964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b5cb5dd85f4f1f88df454c36debcde'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.305807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1300/2547] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:10 2022] DELETE /identity/v3/users/42b5cb5dd85f4f1f88df454c36debcde => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:10.310324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:10.310614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:10.310892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:10.329463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:10.330758 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:10.390741 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1248/2548] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:10.400447 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:10.401858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:10.420410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:10.461712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057f0c3-ed92-481e-9ff7-185a32b06a25 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:10.465379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:10.466013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:10.466296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:10.466576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:10.476062 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:10.477422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:10.486897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1301/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:10.751905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:10.753351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:10.765292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd346e-ec7e-4554-b716-cee494964d31 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:10.769955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:10.770821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:10.771094 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:10.771364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] PATH_INFO: `/v3/projects/7fd80d911b7842338f9be85d61cfe861` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:10.772778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd80d911b7842338f9be85d61cfe861)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:10.774578 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:10.822917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd80d911b7842338f9be85d61cfe861', 'request_id': 'req-2fe70db1-f018-4eea-850f-670b486ab568'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.830766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd80d911b7842338f9be85d61cfe861', 'request_id': 'req-2fe70db1-f018-4eea-850f-670b486ab568'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.836957 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd80d911b7842338f9be85d61cfe861', 'request_id': 'req-2fe70db1-f018-4eea-850f-670b486ab568'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.848103 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] The token cache is being invalidate because project 7fd80d911b7842338f9be85d61cfe861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:10.848394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.849058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.851228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1249/2550] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:10 2022] DELETE /identity/v3/projects/7fd80d911b7842338f9be85d61cfe861 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:10.855245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:10.865129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71bfbe-6b3b-4585-8a85-05f9cf10c956 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:10.923443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:10.924486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:10.924772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:10.925050 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] PATH_INFO: `/v3/users/deb10f0177374b28ac0070595d658b48` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:10.926264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb10f0177374b28ac0070595d658b48)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:10.928240 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:10.980903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb10f0177374b28ac0070595d658b48'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.988059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb10f0177374b28ac0070595d658b48'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:10.999822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb10f0177374b28ac0070595d658b48'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.006554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb10f0177374b28ac0070595d658b48'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.007214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-2eea07a8-5e92-4cd0-b556-9408823842ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb10f0177374b28ac0070595d658b48'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.013283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1302/2551] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:10 2022] DELETE /identity/v3/users/deb10f0177374b28ac0070595d658b48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:11.290338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.291937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:11.305484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70db1-f018-4eea-850f-670b486ab568 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.356373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:11.364607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.365646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.366138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.366480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] PATH_INFO: `/v3/projects/2fd34d41a98a492fb8d0ad308a04f809` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.367968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd34d41a98a492fb8d0ad308a04f809)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.369969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.416656 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd34d41a98a492fb8d0ad308a04f809', 'request_id': 'req-e0ebf41d-4b8c-40b3-a987-598a18ed7934'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.424157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd34d41a98a492fb8d0ad308a04f809', 'request_id': 'req-e0ebf41d-4b8c-40b3-a987-598a18ed7934'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.429761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd34d41a98a492fb8d0ad308a04f809', 'request_id': 'req-e0ebf41d-4b8c-40b3-a987-598a18ed7934'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.440732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] The token cache is being invalidate because project 2fd34d41a98a492fb8d0ad308a04f809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:11.441025 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.441675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e0ebf41d-4b8c-40b3-a987-598a18ed7934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:11.443254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1250/2552] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:11 2022] DELETE /identity/v3/projects/2fd34d41a98a492fb8d0ad308a04f809 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:11.451118 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.451616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.451727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.470846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:11.472218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:11.507605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:11.546103 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1303/2553] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:11.554160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.554452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.554734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.573474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:11.574671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:11.582633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1251/2554] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:11.587382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.597768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503e548-ad33-4de9-b78b-1f5a457b1753 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.602452 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.603101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.603390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.603702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.604463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:55:11.604772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.606367 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.618158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1304/2555] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:55:11.622389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.632229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21115f8d-9afb-41ba-b34c-e4c622ee9428 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.637035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.637734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.638024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.638337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.639042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.640974 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.667365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1252/2556] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:55:11 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:11.671560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.681525 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716387e1-fa72-40d7-98b6-32fe21aec5c8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.738216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.738880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.739170 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.739482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.740188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.742621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.763305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1305/2557] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:55:11 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:55:11.767667 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.778153 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65675d-b9b4-4fbe-a149-64cf92204e68 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.782850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.783489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.783771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.784047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.784775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.786456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.798001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1253/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:11.802250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.813154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ba60-4448-480a-9daf-34038ff651ba admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.818763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.820115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.820398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.820701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.821454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.823228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63770db8-c17a-43c2-9c99-0809384a6a98 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.833990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1306/2559] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:55:11.838272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:11.848618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596e5a5-6ce7-49c9-ae5c-281d12f63075 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:11.853270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:11.854137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.854423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.854700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] PATH_INFO: `/v3/projects/f9e4da40fe894f09bb747fa8f04fb25f/users/b4cab5f5092546108d00fc07a839e2ee/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.869591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e4da40fe894f09bb747fa8f04fb25f, user_id=b4cab5f5092546108d00fc07a839e2ee, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:11.872234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:11.886246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1254/2560] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:55:11 2022] PUT /identity/v3/projects/f9e4da40fe894f09bb747fa8f04fb25f/users/b4cab5f5092546108d00fc07a839e2ee/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:11.896704 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:11.897005 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:11.897292 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:11.925068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] MFA Rules not processed for user `b4cab5f5092546108d00fc07a839e2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:11.926295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:11.990577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1307/2561] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:12.002397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:12.004119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:12.061125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4ebb-cc99-4704-b3af-e9948eabdf18 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:12.064751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:12.065388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:12.065671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:12.065952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:12.074943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:12.076387 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944887c-945f-431d-ac1b-5cc1f8aeeac0 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:12.085075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1255/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:17.201152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:17.234716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:17.264643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391d76-cee5-4c8c-b6cc-eb1a4b34fbbc None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:17.269279 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:17.270153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:17.270440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:17.270719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] PATH_INFO: `/v3/users/b4cab5f5092546108d00fc07a839e2ee` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:17.271954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cab5f5092546108d00fc07a839e2ee)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:17.273890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:17.319160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cab5f5092546108d00fc07a839e2ee'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.327347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cab5f5092546108d00fc07a839e2ee'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.339268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cab5f5092546108d00fc07a839e2ee'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.346557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cab5f5092546108d00fc07a839e2ee'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.347200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cab5f5092546108d00fc07a839e2ee'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.353597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1308/2563] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:55:17 2022] DELETE /identity/v3/users/b4cab5f5092546108d00fc07a839e2ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:17.358148 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:17.358642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:17.358751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:17.376455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:17.377644 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:17.395827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:17.438983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1256/2564] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:17.448889 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:17.450379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:17.507300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7cf-94ff-49de-b287-62923048c04e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:17.510990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:17.511665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:17.511976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:17.512254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:17.522935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:17.524649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d3331-fe2f-4717-b595-6666ba417c77 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:17.537045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1309/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:17.818518 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:17.820400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:17.833457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e7053-8b35-40c4-88a6-fa08aa56193e None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:17.838662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:17.839571 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:17.839860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:17.840138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] PATH_INFO: `/v3/projects/f9e4da40fe894f09bb747fa8f04fb25f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:17.841366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e4da40fe894f09bb747fa8f04fb25f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:17.843282 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:17.892930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e4da40fe894f09bb747fa8f04fb25f', 'request_id': 'req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.901793 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e4da40fe894f09bb747fa8f04fb25f', 'request_id': 'req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.910795 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e4da40fe894f09bb747fa8f04fb25f', 'request_id': 'req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.924955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] The token cache is being invalidate because project f9e4da40fe894f09bb747fa8f04fb25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:55:17.925244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.925946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:55:17.927802 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1257/2566] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:55:17 2022] DELETE /identity/v3/projects/f9e4da40fe894f09bb747fa8f04fb25f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:55:27.532757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:27.920946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:33.701695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7cfb-3ea1-4925-a77d-e1c23403953f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:33.702276 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7cfb-3ea1-4925-a77d-e1c23403953f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:33.702406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7cfb-3ea1-4925-a77d-e1c23403953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:33.726808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-4c2e7cfb-3ea1-4925-a77d-e1c23403953f None None] MFA Rules not processed for user `5d0090359d7c46038b82bbb903abab93`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:55:33.728079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-4c2e7cfb-3ea1-4925-a77d-e1c23403953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:33.785193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1310/2567] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:55:34.097315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:55:34.098944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:34.159288 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ba9fa-a90a-425b-af6a-8076dd05cb2d admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:55:34.162927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:55:34.163623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:55:34.163910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:55:34.164191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:55:34.166483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:55:34.176276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:55:34.177764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:55:34.186473 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1258/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:55:43.778345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=25 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:55:44.182880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=26 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:10.817013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bbe4-b688-4a03-8b03-6d35838cf29d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:10.817511 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bbe4-b688-4a03-8b03-6d35838cf29d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:10.817612 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187bbe4-b688-4a03-8b03-6d35838cf29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:10.836079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7187bbe4-b688-4a03-8b03-6d35838cf29d None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:56:10.837277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7187bbe4-b688-4a03-8b03-6d35838cf29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:10.896748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1311/2569] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:56:10.944827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:56:10.946254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:11.018900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7aaa8f-07b2-4e54-befa-e355e0e63eb1 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:56:11.023887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:56:11.024545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:11.024833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:11.025111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:11.033664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:56:11.035252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:56:11.043371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1259/2570] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:56:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:56:20.889437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=25 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:21.040130 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=32 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:26.303261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878de4e-8247-4e61-afc8-cd5c672a6538 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:26.303758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878de4e-8247-4e61-afc8-cd5c672a6538 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:26.303849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878de4e-8247-4e61-afc8-cd5c672a6538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:26.341607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c878de4e-8247-4e61-afc8-cd5c672a6538 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:56:26.342812 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c878de4e-8247-4e61-afc8-cd5c672a6538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:26.376989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1312/2571] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:56:26.389017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:56:26.429612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567db2-3670-4c1b-ba8b-181bb709e221 service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:56:26.435245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:56:26.435919 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:26.436209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:26.436489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:26.444702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:56:26.446278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:56:26.454399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1260/2572] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:56:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:56:36.375309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=23 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:36.451105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=20 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:42.529932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:42.530391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:42.530485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:42.549536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:56:42.550860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:42.558272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1313/2573] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:56:42.571377 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:56:42.583924 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab6743-4f61-433e-8376-b74aeac05b0d service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:56:42.589356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:56:42.590008 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:42.590298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:42.590577 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:42.603583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:56:42.605397 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:56:42.613917 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1261/2574] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 14:56:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 14:56:43.012210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:56:43.013599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:43.106479 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575e7eb-6a8e-4e9e-a2d2-9b4582397958 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:56:43.112401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:56:43.113065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:56:43.113376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:56:43.113655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:56:43.115478 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:56:43.127971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:56:43.129570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:56:43.141084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1314/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:56:52.610559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:56:53.135904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=44 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:16.114331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:16.133717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63767e9-939a-4a9f-b41d-24b0fe7cccf8 service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:16.137569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:16.138227 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:16.138515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:16.138819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:16.141697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:16.227588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:16.229040 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:16.248142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1262/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:19.489642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:19.511043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2fb0c-5c32-47c0-bf64-917545cebb8f service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:19.520453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:19.521509 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:19.523755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:19.523755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:19.526339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:19.550165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:19.551630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:19.559718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:19.561482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:19.565568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89947733-1762-44e2-9f0e-287026c31ac4 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:19.570727 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:19.571794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:19.572013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:19.572263 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] PATH_INFO: `/v3/users/5d0090359d7c46038b82bbb903abab93` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:19.573960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0090359d7c46038b82bbb903abab93)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:19.575214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1315/2577] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:19.575950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:19.641592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0090359d7c46038b82bbb903abab93'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.655032 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0090359d7c46038b82bbb903abab93'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.669905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0090359d7c46038b82bbb903abab93'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.670621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0090359d7c46038b82bbb903abab93'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.678513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-03ba54a9-d917-4e16-b612-490c993b0f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0090359d7c46038b82bbb903abab93'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.684443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1263/2578] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:19 2022] DELETE /identity/v3/users/5d0090359d7c46038b82bbb903abab93 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:19.858727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:19.871120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f75a-1dd4-4e97-bb43-fac05d2c9b0e service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:19.936502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:19.937392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:19.937661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:19.937942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] PATH_INFO: `/v3/projects/b64ae384481e48469c50e900ac7473da` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:19.939153 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64ae384481e48469c50e900ac7473da)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:19.941119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:19.988008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64ae384481e48469c50e900ac7473da', 'request_id': 'req-182ba670-e076-4ff7-839f-dadf7c91d9cc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:19.997100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64ae384481e48469c50e900ac7473da', 'request_id': 'req-182ba670-e076-4ff7-839f-dadf7c91d9cc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:20.002988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64ae384481e48469c50e900ac7473da', 'request_id': 'req-182ba670-e076-4ff7-839f-dadf7c91d9cc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:20.014501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] The token cache is being invalidate because project b64ae384481e48469c50e900ac7473da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:20.014792 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:20.015465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-182ba670-e076-4ff7-839f-dadf7c91d9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:20.017257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1316/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:19 2022] DELETE /identity/v3/projects/b64ae384481e48469c50e900ac7473da => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:20.022142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.022436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.022716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.061154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:20.084775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:20.086000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:20.147315 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1264/2580] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:20.155116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.155407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.155740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.173902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:20.175110 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:20.183250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1317/2581] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:20.187480 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.197260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da12e-27a0-4f45-8428-539ee973fc11 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.201886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.202544 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.202833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.203638 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.204374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:57:20.204687 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.206381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.218423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1265/2582] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:57:20.223539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.232770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2e526-9f17-4476-8fa7-6c61ecee6157 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.237427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.238129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.238363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.238641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.239334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.241283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.271238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1318/2583] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:20 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:20.275423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.286211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e6ae-26a8-44d1-82f8-da9e6705c161 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.341947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.342625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.343019 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.343311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.344750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.347078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.367107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1266/2584] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:20 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:20.371221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.381872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93b2e1-1267-434f-b4d5-2455f483e353 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.386575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.387241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.387636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.387845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.388644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.390251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.401042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1319/2585] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:20.404711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.415200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb1261-91bb-4605-92da-87736bd54900 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.420721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.421496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.421887 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.422269 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.423105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.424873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efd3bc-9e0d-4623-b41a-55a46b435fbf admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.438541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1267/2586] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:20.439679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.449615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3e0d-2123-446b-8e86-c5f52c6667e2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.454775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.455672 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.455956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.456232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] PATH_INFO: `/v3/projects/549b8e02d84d46cd889b272be07ef19b/users/2eaff9315db446c5b4a5be561e369901/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.472405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=549b8e02d84d46cd889b272be07ef19b, user_id=2eaff9315db446c5b4a5be561e369901, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.475063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.489038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1320/2587] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:20 2022] PUT /identity/v3/projects/549b8e02d84d46cd889b272be07ef19b/users/2eaff9315db446c5b4a5be561e369901/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:57:20.499706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.500507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.500796 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.528125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] MFA Rules not processed for user `2eaff9315db446c5b4a5be561e369901`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:20.529356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:20.589652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:20.601449 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1268/2588] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:20.612410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:20.614214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:20.632522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:20.696082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c362-93b9-44bf-b6d5-e7a769b8eb7c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:20.699843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:20.700488 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:20.700775 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:20.701056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:20.710187 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:20.711655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f4ba8-ca26-41c0-969b-d944008440b3 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:20.720472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1321/2589] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:29.019283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.081695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce3ed9-7da5-4400-b5d0-36b05070632c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:29.086165 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:29.087030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.087313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.087622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] PATH_INFO: `/v3/users/2eaff9315db446c5b4a5be561e369901` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.088809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaff9315db446c5b4a5be561e369901)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:29.090704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:29.137562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaff9315db446c5b4a5be561e369901'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.145607 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaff9315db446c5b4a5be561e369901'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.157682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaff9315db446c5b4a5be561e369901'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.158450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaff9315db446c5b4a5be561e369901'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.165232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaff9315db446c5b4a5be561e369901'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.171267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1269/2590] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:29 2022] DELETE /identity/v3/users/2eaff9315db446c5b4a5be561e369901 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:29.176548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.177026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.177119 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.195032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:29.196277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:29.256786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1322/2591] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:29.266385 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.267898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:29.340813 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422f10-08d0-49cf-a5d9-38a4ab1a5b39 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:29.344532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:29.345189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.345475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.345756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.355135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:29.356618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd18be-b5cc-4845-b400-33252a0e5920 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:29.366781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1270/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:29.635497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.636935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:29.649422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9502-ebac-4f40-9003-4bf5418fe3e8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:29.655006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:29.655922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.656730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.657008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] PATH_INFO: `/v3/projects/549b8e02d84d46cd889b272be07ef19b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.658935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549b8e02d84d46cd889b272be07ef19b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:29.661144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:29.709865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549b8e02d84d46cd889b272be07ef19b', 'request_id': 'req-8007957f-a6f4-4467-845a-ba1cd5a1fef0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.717664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549b8e02d84d46cd889b272be07ef19b', 'request_id': 'req-8007957f-a6f4-4467-845a-ba1cd5a1fef0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.724138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549b8e02d84d46cd889b272be07ef19b', 'request_id': 'req-8007957f-a6f4-4467-845a-ba1cd5a1fef0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.735780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] The token cache is being invalidate because project 549b8e02d84d46cd889b272be07ef19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:29.736075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.736737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-8007957f-a6f4-4467-845a-ba1cd5a1fef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:29.738303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1323/2593] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:29 2022] DELETE /identity/v3/projects/549b8e02d84d46cd889b272be07ef19b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:29.743272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.743592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.743874 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.751237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:29.763108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:29.764301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:29.824036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1271/2594] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:29.832615 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.832911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.833194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.852558 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:29.853771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:29.861702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1324/2595] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:29.865975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.875860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a52ae-56a5-422a-9ba2-355e8167bdda None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:29.880464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:29.881146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.881405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.881684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.882424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:57:29.882742 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:29.884367 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:29.896876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1272/2596] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:57:29.901589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.913026 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68e6a4-e002-4e88-8989-d2779d92e19a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:29.919266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:29.919963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:29.920317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:29.920524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:29.921229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:29.923134 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:29.933266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:29.949526 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1325/2597] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:29 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:29.954219 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:29.964418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f8a0b-afef-4740-9028-ce9eb1d95be9 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.020696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.021351 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.021558 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.021838 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.022537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.024481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.045909 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1273/2598] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:29 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:30.050192 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.060733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767df47-2f73-4c97-b1a0-08af57a8cfe2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.065691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.066441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.066638 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.066920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.067729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.069337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.087246 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1326/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:30.091354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.102499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f46ddf-81ee-4de7-b3f8-c89df13040c4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.107168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.107873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.108163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.108447 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.109181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.110883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27b5e-d751-40ca-8ace-00778f33dce5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.120760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1274/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:30.124899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.135117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93ca7-4ba9-4d97-b1d5-c865208448cb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.139841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.140702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.140987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.141752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] PATH_INFO: `/v3/projects/20a650b0ce40452ba0420e469e281cfb/users/bf00885999ef455ca35962ad700387d6/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.156597 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a650b0ce40452ba0420e469e281cfb, user_id=bf00885999ef455ca35962ad700387d6, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.160323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.174197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1327/2601] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:30 2022] PUT /identity/v3/projects/20a650b0ce40452ba0420e469e281cfb/users/bf00885999ef455ca35962ad700387d6/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:30.184815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.185141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.185431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.215358 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] MFA Rules not processed for user `bf00885999ef455ca35962ad700387d6`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:30.216711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:30.278044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:30.282258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1275/2602] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:30.286748 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.348910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78937-20b6-4f0e-b076-7d067e902d4b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.353637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.354303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.354591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.354866 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.355603 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.357513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.388952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1328/2603] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:30 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:30.393217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.403966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b74f7-8776-4685-8754-a6e6af67d2ca None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.460108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.460785 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.461076 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.461356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.462138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.464211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.486030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1276/2604] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:30 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:30.490395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.501025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d8a1-034d-4257-bc43-5aed962b3c04 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.505696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.506355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.506642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.506922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.507697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.509668 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.520688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1329/2605] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:30.525058 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.536097 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c16109-9793-401e-bcb2-bbb9c1995d3b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.540767 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.541658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.541942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.542218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] PATH_INFO: `/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3/users/dde4ae8d22f84378a2555f41effc6cb1/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.558343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3e291d3934f2a8d5f31c1ac64b4d3, user_id=dde4ae8d22f84378a2555f41effc6cb1, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.561028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.574672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1277/2606] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:30 2022] PUT /identity/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3/users/dde4ae8d22f84378a2555f41effc6cb1/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:30.579167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.589521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57e71-a01a-4960-bce0-7f9613477fb4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.645825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.646501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.646787 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.647100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.647873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.649483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0e229-0f70-45c6-8142-eff81fcaac14 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.660072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1330/2607] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:30.664304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.674733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b478946-5017-4c5a-8c8b-aad2b476271e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.679302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.680215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.680531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.680809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] PATH_INFO: `/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3/users/dde4ae8d22f84378a2555f41effc6cb1/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.682775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3e291d3934f2a8d5f31c1ac64b4d3, user_id=dde4ae8d22f84378a2555f41effc6cb1, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.685423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.695621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1278/2608] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:30 2022] PUT /identity/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3/users/dde4ae8d22f84378a2555f41effc6cb1/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:57:30.707598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.707893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.708176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.735261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] MFA Rules not processed for user `dde4ae8d22f84378a2555f41effc6cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:30.736589 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:30.749247 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:30.808523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1331/2609] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:30.819991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.821719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:30.879276 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0e157-249a-4f8e-90e4-2cd222a013e1 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.883146 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.883824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.884117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.884399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:30.894150 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:30.895895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:30.905704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1279/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:30.977570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:30.987836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a8858-910d-40fb-bb95-0ec7a9f94a28 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:30.991625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:30.992267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:30.992574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:30.992849 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:31.050592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:31.052080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d9e4c-f1ef-4cdb-8aad-15ad26c8afee service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:31.061300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1332/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:33.769340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:33.832559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:33.839903 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80563b9c-a041-477c-814d-4a86ae864608 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:33.846361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:33.847537 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:33.847818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:33.848093 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] PATH_INFO: `/v3/users/bf00885999ef455ca35962ad700387d6` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:33.849365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf00885999ef455ca35962ad700387d6)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:33.851381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:33.902257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf00885999ef455ca35962ad700387d6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:33.914200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf00885999ef455ca35962ad700387d6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:33.926809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf00885999ef455ca35962ad700387d6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:33.927598 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf00885999ef455ca35962ad700387d6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:33.934975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf00885999ef455ca35962ad700387d6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:33.942800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1280/2612] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:33 2022] DELETE /identity/v3/users/bf00885999ef455ca35962ad700387d6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:33.947463 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:33.947948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:33.948056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:33.966914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:33.968159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:34.038139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1333/2613] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:34.048128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:34.049641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:34.110208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b143ea-0388-4a57-b6fa-e5dbbf6bfaee admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:34.114126 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:34.114771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:34.115056 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:34.115333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:34.125528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:34.127715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:34.137800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1281/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:34.689507 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:34.691430 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:34.705831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df59250-d92e-410d-9e21-58edab434a5d None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:34.710408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:34.711815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:34.712298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:34.712577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] PATH_INFO: `/v3/projects/20a650b0ce40452ba0420e469e281cfb` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:34.713890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a650b0ce40452ba0420e469e281cfb)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:34.715923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:34.761216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:34.764483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a650b0ce40452ba0420e469e281cfb', 'request_id': 'req-0de86860-d38b-46ff-9fbc-bebc54f55489'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.772306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a650b0ce40452ba0420e469e281cfb', 'request_id': 'req-0de86860-d38b-46ff-9fbc-bebc54f55489'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.777907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a650b0ce40452ba0420e469e281cfb', 'request_id': 'req-0de86860-d38b-46ff-9fbc-bebc54f55489'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.790718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] The token cache is being invalidate because project 20a650b0ce40452ba0420e469e281cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:34.791006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.791696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.793255 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1334/2615] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:34 2022] DELETE /identity/v3/projects/20a650b0ce40452ba0420e469e281cfb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:34.797210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:34.807672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598184d4-08e3-4d67-9933-544a65ac49a1 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:34.865110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:34.866017 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:34.866307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:34.866589 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] PATH_INFO: `/v3/users/dde4ae8d22f84378a2555f41effc6cb1` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:34.867856 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde4ae8d22f84378a2555f41effc6cb1)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:34.869772 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:34.890482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:34.918123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde4ae8d22f84378a2555f41effc6cb1'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.925732 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde4ae8d22f84378a2555f41effc6cb1'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.937657 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde4ae8d22f84378a2555f41effc6cb1'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.938297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde4ae8d22f84378a2555f41effc6cb1'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.945154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-a87561c3-35a5-4c55-b47c-5e4e9cc01e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde4ae8d22f84378a2555f41effc6cb1'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:34.950983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1282/2616] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:34 2022] DELETE /identity/v3/users/dde4ae8d22f84378a2555f41effc6cb1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:35.223888 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.225456 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:35.238963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86860-d38b-46ff-9fbc-bebc54f55489 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.296691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.297595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.297911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.298191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] PATH_INFO: `/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.299392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3e291d3934f2a8d5f31c1ac64b4d3)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.301336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.349964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3e291d3934f2a8d5f31c1ac64b4d3', 'request_id': 'req-36edac97-c759-4976-8c95-9e91c2c1089a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:35.357605 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3e291d3934f2a8d5f31c1ac64b4d3', 'request_id': 'req-36edac97-c759-4976-8c95-9e91c2c1089a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:35.364287 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3e291d3934f2a8d5f31c1ac64b4d3', 'request_id': 'req-36edac97-c759-4976-8c95-9e91c2c1089a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:35.375405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] The token cache is being invalidate because project 27d3e291d3934f2a8d5f31c1ac64b4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:35.375755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:35.376401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-36edac97-c759-4976-8c95-9e91c2c1089a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:35.377950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1335/2617] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:35 2022] DELETE /identity/v3/projects/27d3e291d3934f2a8d5f31c1ac64b4d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:35.383395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.383724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.384012 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.402669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:35.403915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:35.462791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1283/2618] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:35.470453 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.470676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.470989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.489805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:35.491019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:35.499054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1336/2619] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:35.503940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.514157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfdd5d-c6fd-4b9d-8265-b22f20a50768 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.519519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.520193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.520481 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.520761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.521507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:57:35.521815 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.523413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.535560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1284/2620] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:57:35.539881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.549595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3afa1b-5b0d-4440-ad27-bcb1e20111d7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.554400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.555054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.555339 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.555660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.556364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.558308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.585881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1337/2621] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:35.590160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.601052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2895-e7ee-4856-ba79-28938e5b26b4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.659630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.660470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.660763 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.661044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.661733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.663675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.684799 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1285/2622] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:35.689610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.699982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0089c0-7d26-4f7f-afef-c870ce8b2ef1 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.705230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.705887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.706177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.706459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.707194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.708835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.719147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1338/2623] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:57:35.723486 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.733326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309a601-3b05-4e9c-85f9-9f7ed72c69f4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.739542 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.740231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.740550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.740835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.741579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.743218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b274-744f-40d6-bda9-01c48e9efeb6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.754334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1286/2624] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:35.758460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.769190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06b1b-467e-4405-ae8d-6e91c5f15447 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.773867 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.774751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.775037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.775319 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] PATH_INFO: `/v3/projects/b8eba7a3ab0d46bfba6b68c357cf34bc/users/080ab2211be44484beccfcd3164c3c86/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.790054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eba7a3ab0d46bfba6b68c357cf34bc, user_id=080ab2211be44484beccfcd3164c3c86, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.792758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:35.803123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:35.808308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1339/2625] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:35 2022] PUT /identity/v3/projects/b8eba7a3ab0d46bfba6b68c357cf34bc/users/080ab2211be44484beccfcd3164c3c86/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:35.819003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.819507 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.819627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.825896 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:35.849290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] MFA Rules not processed for user `080ab2211be44484beccfcd3164c3c86`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:35.850488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:35.915163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1287/2626] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:35.919726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:35.982706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee71fa-888f-4463-8937-013d6d280ebb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:35.987999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:35.988657 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:35.988946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:35.989227 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:35.989931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:35.991869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.017674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1340/2627] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:36.021769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.033090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd23e28-356c-48e0-b7f4-22838a606ce1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.088612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.089287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.089576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.089858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.090559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.092512 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.112832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1288/2628] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:36 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:36.116945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.127418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b338de-81ec-41a9-92fd-c9acdec9f889 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.132108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.132764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.133046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.133325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.134051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.135679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.146885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1341/2629] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:36.151104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.161722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5c74-32bb-4020-9ce3-a57052384353 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.166348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.167228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.167546 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.167829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] PATH_INFO: `/v3/projects/2998a2f0de5d43fd837b59162a2f8a68/users/066248d08666451e9e25924047b53b03/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.183986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2998a2f0de5d43fd837b59162a2f8a68, user_id=066248d08666451e9e25924047b53b03, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.186659 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.200990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1289/2630] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:36 2022] PUT /identity/v3/projects/2998a2f0de5d43fd837b59162a2f8a68/users/066248d08666451e9e25924047b53b03/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:36.205800 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.216886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a7649-df0f-4981-8ece-12756db9b567 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.273085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.273711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.273939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.274210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.274931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.277312 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044578b-be35-47d6-a90b-8faeb3ab5bfd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.293301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1342/2631] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:36.297697 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.308322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7486ca-2996-4dc5-89be-1bf4c9fdde38 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.313606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.314493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.314781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.315064 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] PATH_INFO: `/v3/projects/2998a2f0de5d43fd837b59162a2f8a68/users/066248d08666451e9e25924047b53b03/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.317160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2998a2f0de5d43fd837b59162a2f8a68, user_id=066248d08666451e9e25924047b53b03, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.319853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.330946 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1290/2632] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:36 2022] PUT /identity/v3/projects/2998a2f0de5d43fd837b59162a2f8a68/users/066248d08666451e9e25924047b53b03/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:36.342100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.342401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.342688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.368967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] MFA Rules not processed for user `066248d08666451e9e25924047b53b03`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:36.370178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:36.430727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:36.442080 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1343/2633] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:36.452735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:36.455007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:36.503037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:36.514513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d7ad-2589-4573-8537-df02c38d9ee5 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:36.518279 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:36.518930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:36.519216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:36.519520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:36.575113 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:36.576599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:36.586013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1291/2634] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:39.140633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:39.142248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:39.154481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5fd1c-17f8-4563-a904-688f6f4d85f8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:39.158259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:39.158903 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:39.159186 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:39.159485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:39.171669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:39.171669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:39.181503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1344/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:46.095147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:46.097464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:46.159079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408973-877f-4ef8-a235-eaab6eb90b19 service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:46.163191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:46.163902 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:46.164190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:46.164470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:46.166274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:46.229944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:46.231378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:46.241831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1292/2636] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:49.176602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=8 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:49.414835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:49.417165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:49.477360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:49.478879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:49.507749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af85c-7602-4d10-8ace-cc117d670241 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:49.517727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad518b4-26a3-4364-bd9e-e235610752fe service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:49.523649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:49.524392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:49.524754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:49.525104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:49.526773 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:49.527120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:49.527913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:49.528201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:49.528482 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] PATH_INFO: `/v3/users/f435520f0ee748f1bac962c6b8051f9e` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:49.530304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f435520f0ee748f1bac962c6b8051f9e)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:49.533987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:49.548017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:49.549858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:49.566391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1345/2637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:49.607365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:49.613364 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f435520f0ee748f1bac962c6b8051f9e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.624986 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f435520f0ee748f1bac962c6b8051f9e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.644211 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f435520f0ee748f1bac962c6b8051f9e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.645142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f435520f0ee748f1bac962c6b8051f9e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.654596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-ff6c547d-8730-42cb-b73a-d23812db2a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f435520f0ee748f1bac962c6b8051f9e'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.662543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1293/2638] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:49 2022] DELETE /identity/v3/users/f435520f0ee748f1bac962c6b8051f9e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:49.854503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:49.866896 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb0b71-759e-4b9d-a50a-bd7c66fd843c service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:49.932709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:49.933486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:49.933774 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:49.934053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] PATH_INFO: `/v3/projects/92e8a733299b46399cc6b97fe039cd73` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:49.935271 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e8a733299b46399cc6b97fe039cd73)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:49.937230 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:49.984902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e8a733299b46399cc6b97fe039cd73', 'request_id': 'req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.992890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e8a733299b46399cc6b97fe039cd73', 'request_id': 'req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:49.998961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e8a733299b46399cc6b97fe039cd73', 'request_id': 'req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:50.010968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] The token cache is being invalidate because project 92e8a733299b46399cc6b97fe039cd73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:50.011261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:50.011939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-bc8ba12b-0c5b-4f5e-8325-d30979cb79b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:50.013484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1346/2639] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:49 2022] DELETE /identity/v3/projects/92e8a733299b46399cc6b97fe039cd73 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:50.019291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.019641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.019933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.037960 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:50.039168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:50.102223 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1294/2640] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:57:50.110268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.110567 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.111344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.131344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:50.132656 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:50.142178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1347/2641] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:50.147216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.157205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bf2fc-e647-41c8-b27a-b262c0498094 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.161807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.162461 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.162830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.163114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.163954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:57:50.164270 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.165916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.178488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1295/2642] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:57:50.183195 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.194818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce9ce-c3d2-4791-9cd6-e9cd473d54e0 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.201803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.202752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.203171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.203635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.204727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.207744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.222845 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:50.243984 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1348/2643] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:57:50.248362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.259443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dbfd3-16de-4e73-8391-f3ca97b8511e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.314904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.315612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.315876 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.316152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.316839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.318748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.337779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1296/2644] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:50 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:50.342075 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.352762 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f71e5-001d-4ff6-8d19-f1bcec9f6f6b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.357411 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.358070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.358358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.358643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.359373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.361501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.372149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1349/2645] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:50.376200 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.386685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fb68c-d9ef-43dc-a2ab-a9d677c165aa admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.391253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.391939 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.392262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.392729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.393218 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.394833 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803138-afb1-49c0-9820-2b2678b835ce admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.404622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1297/2646] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:50.409635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.419811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c1d81-18e3-4a50-a1c1-4a516391a4d7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.425221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.426096 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.426385 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.426666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] PATH_INFO: `/v3/projects/757ea32b338942098a62aefec29dbf17/users/557eef8a9358467c89d0b53cf7804264/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.441100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] RBAC: Authorizing `identity:create_grant(project_id=757ea32b338942098a62aefec29dbf17, user_id=557eef8a9358467c89d0b53cf7804264, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.443784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.456825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1350/2647] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:50 2022] PUT /identity/v3/projects/757ea32b338942098a62aefec29dbf17/users/557eef8a9358467c89d0b53cf7804264/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:57:50.461929 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.462231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.462543 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.481305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:50.482525 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:50.503427 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:50.545624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1298/2648] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:50.556072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:50.557808 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:50.616981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34264a0-4ea9-4fd5-9654-12aadc87827b admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:50.620680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:50.621331 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:50.621617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:50.621898 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:50.631480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:50.632930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0295e-4576-4fba-baf6-e72dfc6b7f9a service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:50.642881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1351/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:51.913691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:51.915284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:51.928422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e450d8-3698-4a52-86b0-aedb7f09af11 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:51.934417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:51.935632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:51.936107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:51.936541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] PATH_INFO: `/v3/users/080ab2211be44484beccfcd3164c3c86` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:51.938050 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080ab2211be44484beccfcd3164c3c86)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:51.949696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:52.031623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080ab2211be44484beccfcd3164c3c86'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.042717 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080ab2211be44484beccfcd3164c3c86'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.056562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080ab2211be44484beccfcd3164c3c86'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.058576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080ab2211be44484beccfcd3164c3c86'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.067914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080ab2211be44484beccfcd3164c3c86'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.082550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1299/2650] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:51 2022] DELETE /identity/v3/users/080ab2211be44484beccfcd3164c3c86 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:52.088781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:52.089322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:52.089322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:52.131850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:52.133123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:52.219480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1352/2651] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:57:52.228752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:52.230299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:52.295921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b95c-32d8-4e18-9c0d-8900a1352c85 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:52.300107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:52.300760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:52.301042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:52.301319 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:52.312036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:52.314256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:52.327099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1300/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:52.625766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:52.627263 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:52.641417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13601f-059f-45a8-9e82-8fc86cab6952 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:52.649072 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:52.650322 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:52.650415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:52.650691 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] PATH_INFO: `/v3/projects/b8eba7a3ab0d46bfba6b68c357cf34bc` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:52.655853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eba7a3ab0d46bfba6b68c357cf34bc)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:52.658369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:52.731621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eba7a3ab0d46bfba6b68c357cf34bc', 'request_id': 'req-5412c4b6-d75f-488d-9036-84c91e05007d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.741983 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:52.751144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eba7a3ab0d46bfba6b68c357cf34bc', 'request_id': 'req-5412c4b6-d75f-488d-9036-84c91e05007d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.760445 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eba7a3ab0d46bfba6b68c357cf34bc', 'request_id': 'req-5412c4b6-d75f-488d-9036-84c91e05007d'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.773235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] The token cache is being invalidate because project b8eba7a3ab0d46bfba6b68c357cf34bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:52.773547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.774210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.778622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1353/2653] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:52 2022] DELETE /identity/v3/projects/b8eba7a3ab0d46bfba6b68c357cf34bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:52.780640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:52.790568 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902b92-e9dc-49d9-8306-7f90af6816a7 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:52.851072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:52.872409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:52.873404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:52.873921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:52.874284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] PATH_INFO: `/v3/users/066248d08666451e9e25924047b53b03` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:52.876110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066248d08666451e9e25924047b53b03)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:52.878953 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:52.943349 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066248d08666451e9e25924047b53b03'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.955679 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066248d08666451e9e25924047b53b03'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.969639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066248d08666451e9e25924047b53b03'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.970441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066248d08666451e9e25924047b53b03'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.978304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-b16de054-cfb3-4722-9be2-b4773250b2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066248d08666451e9e25924047b53b03'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:52.985229 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1301/2654] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:52 2022] DELETE /identity/v3/users/066248d08666451e9e25924047b53b03 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:53.421805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:53.423443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:53.436643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c4b6-d75f-488d-9036-84c91e05007d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:53.552141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:53.553295 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:53.553696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:53.554079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] PATH_INFO: `/v3/projects/2998a2f0de5d43fd837b59162a2f8a68` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:53.556585 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2998a2f0de5d43fd837b59162a2f8a68)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:53.560108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:53.661757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2998a2f0de5d43fd837b59162a2f8a68', 'request_id': 'req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:53.672947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2998a2f0de5d43fd837b59162a2f8a68', 'request_id': 'req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:53.690226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2998a2f0de5d43fd837b59162a2f8a68', 'request_id': 'req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:53.709369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] The token cache is being invalidate because project 2998a2f0de5d43fd837b59162a2f8a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:57:53.709978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:53.711660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-9e16d044-7ecc-4c46-8bf5-302fe9ff1e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:53.717522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1354/2655] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:57:53 2022] DELETE /identity/v3/projects/2998a2f0de5d43fd837b59162a2f8a68 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:53.718985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:53.719321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:53.719627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:53.758081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:53.760372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:53.839597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1302/2656] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:53.843956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:53.844317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:53.844671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:53.868566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:53.869821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:53.880992 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1355/2657] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:53.884980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:53.896041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafec19-b67c-46fd-b953-4b4ee4ca2cb7 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:53.901599 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:53.902600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:53.902600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:53.902893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:53.903637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:57:53.904022 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:53.905674 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:53.924748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1303/2658] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 14:57:53.926480 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:53.942931 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5104161-a761-41aa-bc94-dcec55c7aed7 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:53.948777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:53.949575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:53.950569 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:53.952232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:53.953296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:53.956206 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:53.990258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1356/2659] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:53 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:53.994853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.006078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e96e2-7faa-47d2-aa20-21d91a3cbe80 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.065044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:54.083343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.084141 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.084492 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.085041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.085637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.087670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.113224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1304/2660] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:53 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:54.117864 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.130757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e1507-9c3d-4a51-958e-4cb7005cd410 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.136544 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.136885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.137267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.137843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.138577 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.140337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.156270 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1357/2661] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:54.162291 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.174583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656b770-0a1c-451f-b64d-d71808b8ecf2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.186662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.187362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.188212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.188212 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.188718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.190383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91402e3-4789-414f-a4b0-205f44a15cb9 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.205128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1305/2662] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:54.206412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.223092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd6c3c-3460-4d9e-a5c1-10a0db839b80 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.230353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.231366 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.231975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.232182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] PATH_INFO: `/v3/projects/94be6e5c40654d178276e29b8c141142/users/3734784461e34edfad74fc9ffc39f8fd/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.254003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94be6e5c40654d178276e29b8c141142, user_id=3734784461e34edfad74fc9ffc39f8fd, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.257632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.282357 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1358/2663] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:54 2022] PUT /identity/v3/projects/94be6e5c40654d178276e29b8c141142/users/3734784461e34edfad74fc9ffc39f8fd/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:54.295562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.295915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.296415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.338855 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] MFA Rules not processed for user `3734784461e34edfad74fc9ffc39f8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:54.340805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:54.451940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1306/2664] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:54.452401 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.462863 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:54.545950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435e3e8-bfe5-4e1c-95c9-c9027a954b94 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.552029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.552915 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.553355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.553785 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.555071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.557250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.589440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1359/2665] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:57:54 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:57:54.593343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.605524 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fdf3-df8a-42e1-99c0-5ca223f14c48 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.674620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.675579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.675681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.675950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.676694 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.678623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.711591 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1307/2666] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:57:54 2022] POST /identity/v3/users => generated 306 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:57:54.711825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.724546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e9ef2-4028-4a0e-9272-5d1fa8b4e199 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.730508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.731406 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.731887 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.732169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.732913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.734561 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.746154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1360/2667] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 14:57:54.750338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.763239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e81ad-80f5-42dc-b867-44dd520d52db admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.770324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.771014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.771375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.771800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] PATH_INFO: `/v3/projects/cee5bde621374de5848c77c69f90f10f/users/f7a39e56d9604cc0879884fa4d1966ce/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.788729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee5bde621374de5848c77c69f90f10f, user_id=f7a39e56d9604cc0879884fa4d1966ce, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.791541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.811499 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1308/2668] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:54 2022] PUT /identity/v3/projects/cee5bde621374de5848c77c69f90f10f/users/f7a39e56d9604cc0879884fa4d1966ce/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:54.813981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.831471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2a177-0680-4be0-8e08-9dd5fd936dd7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.918694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.920369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.920663 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.920952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.921905 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.923644 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd33ed-abc9-4804-a4c9-d479d52a38b5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.937304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1361/2669] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:57:54.942418 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:54.957185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8cc8-dbb7-407c-af87-92756fac9dfc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:54.965195 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:54.966254 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:54.966738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:54.967176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] PATH_INFO: `/v3/projects/cee5bde621374de5848c77c69f90f10f/users/f7a39e56d9604cc0879884fa4d1966ce/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:54.969695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee5bde621374de5848c77c69f90f10f, user_id=f7a39e56d9604cc0879884fa4d1966ce, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:54.973944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d908-4206-4359-8c9d-4c8d92811e04 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:54.987670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1309/2670] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:57:54 2022] PUT /identity/v3/projects/cee5bde621374de5848c77c69f90f10f/users/f7a39e56d9604cc0879884fa4d1966ce/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:55.004241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:55.004539 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:55.004829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:55.058350 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] MFA Rules not processed for user `f7a39e56d9604cc0879884fa4d1966ce`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:55.059664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:55.106095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:55.106669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:55.106669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:55.127391 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:55.141566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] MFA Rules not processed for user `557eef8a9358467c89d0b53cf7804264`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:55.145237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:55.177685 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1362/2671] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:55.192576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:55.195345 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:55.204326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:55.239617 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1310/2672] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:55.250124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:55.252882 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:55.270046 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80283221-ef6a-4d92-8e50-c07e532a5027 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:55.273922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:55.274590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:55.274875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:55.275155 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:55.286061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:55.287645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:55.299329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1363/2673] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:57:55.362157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2646fad-0915-48cd-a768-9cb61c05e556 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:55.374104 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:55.374892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:55.375189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:55.375497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:55.386477 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:55.386852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:55.390010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51193b9-f43f-482c-b605-23069c045279 service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:55.397834 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe868d-44d8-4f8c-a219-765cfee188d7 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:55.402066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:55.402827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:55.403097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:55.403408 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:55.408609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1311/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:57:55.493338 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:55.494790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:55.505902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1364/2675] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:57:56.874417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c9a5-4dd5-44c8-9722-2b34a6eeaa69 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:56.874954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c9a5-4dd5-44c8-9722-2b34a6eeaa69 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:56.874954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c9a5-4dd5-44c8-9722-2b34a6eeaa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:56.893848 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-0145c9a5-4dd5-44c8-9722-2b34a6eeaa69 None None] MFA Rules not processed for user `557eef8a9358467c89d0b53cf7804264`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:57:56.895068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0145c9a5-4dd5-44c8-9722-2b34a6eeaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:57:56.902951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1312/2676] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:57:59.786111 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:57:59.860422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ff41b-57f9-4e27-8e38-e39bb9186ecc service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:57:59.865980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:57:59.867123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:59.867419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:59.867788 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] PATH_INFO: `/v3/users/3734784461e34edfad74fc9ffc39f8fd` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:57:59.869532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3734784461e34edfad74fc9ffc39f8fd)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:57:59.871916 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:57:59.941066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3734784461e34edfad74fc9ffc39f8fd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:59.943145 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:57:59.952730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3734784461e34edfad74fc9ffc39f8fd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:59.967422 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3734784461e34edfad74fc9ffc39f8fd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:59.975661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3734784461e34edfad74fc9ffc39f8fd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:59.976370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3734784461e34edfad74fc9ffc39f8fd'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:57:59.982436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1365/2677] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:57:59 2022] DELETE /identity/v3/users/3734784461e34edfad74fc9ffc39f8fd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:57:59.989618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:57:59.990105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:57:59.990201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:00.008304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:00.009641 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:00.071765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:00.082753 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1313/2678] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:00.094086 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:00.096173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:00.160962 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52a77a-01d2-4518-8a21-42d6fe10f8fe admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:00.164629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:00.165470 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:00.166238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:00.166238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:00.177334 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:00.178978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:00.189917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1366/2679] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:00.474550 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:00.476069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:00.489770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a407f-5e2e-40c9-9d33-763b9230b239 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:00.501530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:00.502952 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:00.503246 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:00.503728 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] PATH_INFO: `/v3/projects/94be6e5c40654d178276e29b8c141142` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:00.504931 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94be6e5c40654d178276e29b8c141142)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:00.507517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:00.574726 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94be6e5c40654d178276e29b8c141142', 'request_id': 'req-7264cb66-191b-4b81-94f1-6b247975e5e4'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.583340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94be6e5c40654d178276e29b8c141142', 'request_id': 'req-7264cb66-191b-4b81-94f1-6b247975e5e4'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.590850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94be6e5c40654d178276e29b8c141142', 'request_id': 'req-7264cb66-191b-4b81-94f1-6b247975e5e4'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.610852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] The token cache is being invalidate because project 94be6e5c40654d178276e29b8c141142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:00.612314 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.614459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.618273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1314/2680] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:00 2022] DELETE /identity/v3/projects/94be6e5c40654d178276e29b8c141142 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:00.622127 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:00.634957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278120a2-44ef-41a0-a1e8-4f72de44de4b service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:00.706732 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:00.707701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:00.707975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:00.708254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] PATH_INFO: `/v3/users/f7a39e56d9604cc0879884fa4d1966ce` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:00.709523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a39e56d9604cc0879884fa4d1966ce)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:00.711555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:00.771344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a39e56d9604cc0879884fa4d1966ce'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.782595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a39e56d9604cc0879884fa4d1966ce'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.795369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:00.796893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a39e56d9604cc0879884fa4d1966ce'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.806386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a39e56d9604cc0879884fa4d1966ce'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.807126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-d45a05ce-3fc9-42c7-a1bf-5f35f35fb656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a39e56d9604cc0879884fa4d1966ce'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:00.813243 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1367/2681] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:00 2022] DELETE /identity/v3/users/f7a39e56d9604cc0879884fa4d1966ce => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:58:01.223806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.226068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:01.250994 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264cb66-191b-4b81-94f1-6b247975e5e4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.313274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.314996 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.315284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.315603 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] PATH_INFO: `/v3/projects/cee5bde621374de5848c77c69f90f10f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.316900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee5bde621374de5848c77c69f90f10f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.318835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.370695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee5bde621374de5848c77c69f90f10f', 'request_id': 'req-9047983e-3e6f-4171-b3ab-efe9dfd00d53'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:01.379108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee5bde621374de5848c77c69f90f10f', 'request_id': 'req-9047983e-3e6f-4171-b3ab-efe9dfd00d53'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:01.385631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee5bde621374de5848c77c69f90f10f', 'request_id': 'req-9047983e-3e6f-4171-b3ab-efe9dfd00d53'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:01.398081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] The token cache is being invalidate because project cee5bde621374de5848c77c69f90f10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:01.398404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:01.399080 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-9047983e-3e6f-4171-b3ab-efe9dfd00d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:01.400736 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1315/2682] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:01 2022] DELETE /identity/v3/projects/cee5bde621374de5848c77c69f90f10f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:01.405777 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.406070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.406349 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.425999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:01.427241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:01.503256 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1368/2683] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:01.511359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.511707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.512009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.539646 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:01.541092 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:01.550895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1316/2684] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:01.555076 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.566306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3ff9-63f1-43c3-8489-2486653dbead None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.571204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.571920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.572208 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.572485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.573235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:58:01.573543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.575167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.589622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1369/2685] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:58:01.593738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.599828 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:01.604431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c13f6-892b-4257-a665-5a2064ed855a None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.610787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.612322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.613047 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.613593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.614586 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.617318 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.657625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1317/2686] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:01 2022] POST /identity/v3/projects => generated 409 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:01.659228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.672123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0076312-b6f9-48bb-b65b-4473ff79992f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.754160 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.754860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.755146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.755427 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.756218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.758829 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.782465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1370/2687] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:01 2022] POST /identity/v3/users => generated 305 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:58:01.787131 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.799383 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612faac-38bb-46ff-b75a-490104a22953 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.804242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.804944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.805256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.805531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.806300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.807943 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.819614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1318/2688] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:01.823981 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.834041 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0af10-4d92-4701-ad5e-d98e5c5b42d8 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.838791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.839484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.839768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.840045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.840789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.842400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5def1-a81c-49a7-afd6-96c1d1435923 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.853493 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1371/2689] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:01.857631 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:01.868783 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521063-eade-4869-9e0e-fc0806ec9500 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:01.873409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:01.874299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.874582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.874861 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] PATH_INFO: `/v3/projects/08206336e59649e592d6b89165e035b7/users/ca8c0e72d15a48998fe0c1076fff963f/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.889721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08206336e59649e592d6b89165e035b7, user_id=ca8c0e72d15a48998fe0c1076fff963f, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:01.892441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:01.911320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1319/2690] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:01 2022] PUT /identity/v3/projects/08206336e59649e592d6b89165e035b7/users/ca8c0e72d15a48998fe0c1076fff963f/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:01.922822 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:01.923158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:01.924137 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:01.954330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] MFA Rules not processed for user `ca8c0e72d15a48998fe0c1076fff963f`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:01.956128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:02.017313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:02.051028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1372/2691] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:02.055620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.135608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f2d56-fee0-4f42-af8d-c4fdb108ea08 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.140648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.141333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.141622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.141904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.143230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.145262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.179106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1320/2692] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:02 2022] POST /identity/v3/projects => generated 407 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:02.183244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.195188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68cfd2-e448-43fc-8f00-263d94957cea None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.266296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.266988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.267828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.268231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.268953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.271042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.298314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1373/2693] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:02 2022] POST /identity/v3/users => generated 310 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:02.302147 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.323620 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d94e4-6fab-48d0-8af2-c918b9766b3c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.329328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.330554 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.330842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.331129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.332111 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.333955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.357854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1321/2694] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:02.359619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.385973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f3f-aea3-4c5b-9161-78f2d963ee29 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.391229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.392696 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.392989 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.393421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] PATH_INFO: `/v3/projects/38d1b6355c914141bf7044ff9b535c43/users/37718701218649bfb9ef5f5358dc7750/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.410769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1b6355c914141bf7044ff9b535c43, user_id=37718701218649bfb9ef5f5358dc7750, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.413568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.429459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1374/2695] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:02 2022] PUT /identity/v3/projects/38d1b6355c914141bf7044ff9b535c43/users/37718701218649bfb9ef5f5358dc7750/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:58:02.433457 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.444967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eaa7-5372-4390-9aaa-afa83157adb0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.512770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.513453 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.513740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.514070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.514899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.516835 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b6b18-69d0-44f2-8619-7508f9345579 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.532373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1322/2696] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:02.533618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.544655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252cf76-5944-4b8a-91a7-bb7bf115618e admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.550882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.552016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.552304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.552580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] PATH_INFO: `/v3/projects/38d1b6355c914141bf7044ff9b535c43/users/37718701218649bfb9ef5f5358dc7750/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.554991 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1b6355c914141bf7044ff9b535c43, user_id=37718701218649bfb9ef5f5358dc7750, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.557694 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.573232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1375/2697] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:02 2022] PUT /identity/v3/projects/38d1b6355c914141bf7044ff9b535c43/users/37718701218649bfb9ef5f5358dc7750/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:02.585099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.585300 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.585585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.612791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] MFA Rules not processed for user `37718701218649bfb9ef5f5358dc7750`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:02.614152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:02.619611 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:02.685752 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1323/2698] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:02.697320 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.699087 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:02.769631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18835-445f-4078-8b39-4fdf549043b2 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.773326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.773980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.774268 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.774551 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:02.784664 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:02.786116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:02.795770 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1376/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:02.946309 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:02.957826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98740730-23b8-48e4-9450-a7386af9e63d None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:02.961725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:02.962369 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:02.962651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:02.962955 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:03.021332 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:03.022791 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec1f8-ef90-4182-82c8-ddd618bf5568 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:03.033183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1324/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:08.302963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:08.345642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:08.370731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c199-2dd4-4ff3-b4c0-96dc45a67975 service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:08.381920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:08.382819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:08.383133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:08.383394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] PATH_INFO: `/v3/users/ca8c0e72d15a48998fe0c1076fff963f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:08.384884 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8c0e72d15a48998fe0c1076fff963f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:08.386827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:08.435231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8c0e72d15a48998fe0c1076fff963f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:08.442455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8c0e72d15a48998fe0c1076fff963f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:08.454283 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8c0e72d15a48998fe0c1076fff963f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:08.461090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8c0e72d15a48998fe0c1076fff963f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:08.461749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8c0e72d15a48998fe0c1076fff963f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:08.467810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1377/2701] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:08 2022] DELETE /identity/v3/users/ca8c0e72d15a48998fe0c1076fff963f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:08.473123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:08.473614 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:08.473719 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:08.493014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:08.494240 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:08.565249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1325/2702] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:08.574918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:08.576485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:08.635635 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1253e-c05e-4850-be76-47f1add3c86f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:08.639875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:08.640534 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:08.640817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:08.641090 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:08.651043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:08.652529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:08.664215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1378/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:08.952683 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:08.954941 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:08.972506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239cde1-1d0e-400e-94c6-d92f01295831 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:08.977464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:08.978350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:08.978691 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:08.978978 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] PATH_INFO: `/v3/projects/08206336e59649e592d6b89165e035b7` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:08.980236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08206336e59649e592d6b89165e035b7)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:08.982181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:09.021267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:09.031472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08206336e59649e592d6b89165e035b7', 'request_id': 'req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.039413 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08206336e59649e592d6b89165e035b7', 'request_id': 'req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.045326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08206336e59649e592d6b89165e035b7', 'request_id': 'req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.057090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] The token cache is being invalidate because project 08206336e59649e592d6b89165e035b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:09.057374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.058048 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.059561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1326/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:08 2022] DELETE /identity/v3/projects/08206336e59649e592d6b89165e035b7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 14:58:09.063409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:09.073536 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6a9f-f70a-4473-8685-755e5e408c04 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:09.135722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:09.136609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.136900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.137183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] PATH_INFO: `/v3/users/37718701218649bfb9ef5f5358dc7750` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.138435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37718701218649bfb9ef5f5358dc7750)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:09.140423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:09.142114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:09.191335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37718701218649bfb9ef5f5358dc7750'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.199921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37718701218649bfb9ef5f5358dc7750'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.213746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37718701218649bfb9ef5f5358dc7750'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.221904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37718701218649bfb9ef5f5358dc7750'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.222879 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-38be4eb8-88f4-4e63-9aa3-052af966d53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37718701218649bfb9ef5f5358dc7750'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.229200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1379/2705] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:09 2022] DELETE /identity/v3/users/37718701218649bfb9ef5f5358dc7750 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:09.502517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:09.504109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:09.519422 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e655c8-ce9c-4dd2-a0b8-827ab67327fc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:09.580669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:09.581968 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.582252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.582532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] PATH_INFO: `/v3/projects/38d1b6355c914141bf7044ff9b535c43` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.583749 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d1b6355c914141bf7044ff9b535c43)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:09.585662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:09.632238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d1b6355c914141bf7044ff9b535c43', 'request_id': 'req-32d29829-1bea-4a81-9d19-3307bf091121'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.639580 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d1b6355c914141bf7044ff9b535c43', 'request_id': 'req-32d29829-1bea-4a81-9d19-3307bf091121'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.645760 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d1b6355c914141bf7044ff9b535c43', 'request_id': 'req-32d29829-1bea-4a81-9d19-3307bf091121'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.656643 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] The token cache is being invalidate because project 38d1b6355c914141bf7044ff9b535c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:09.656937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.657583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-32d29829-1bea-4a81-9d19-3307bf091121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:09.659117 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1327/2706] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:09 2022] DELETE /identity/v3/projects/38d1b6355c914141bf7044ff9b535c43 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:09.665045 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.665518 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.665632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.684531 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:09.685769 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:09.746752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1380/2707] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:58:09.809618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.809913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.810198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.829267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:09.830483 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:09.839224 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1328/2708] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:09.843548 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:09.854369 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c685d3c-d889-4f17-b52a-bd40fc69b899 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:09.859231 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:09.859950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.860235 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.860520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.861253 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:58:09.861687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:09.863421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:09.876310 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1381/2709] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:58:09.881469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:09.891013 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8b092-8690-475a-9cb7-369b4ee1fdd1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:09.896527 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:09.897191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.897484 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.897764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:09.898475 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:09.900434 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:09.926409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1329/2710] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:09 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:09.930677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:09.941545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2bf0-a1eb-4bfc-9ffb-329cb464a4af admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:09.998360 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:09.999036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:09.999324 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:09.999641 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.000375 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.002294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.012351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:10.027514 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1382/2711] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:09 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:10.031114 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.045985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfccd2-e80f-4cde-92d0-3fcfd79e53ce admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.051256 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.052129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.052420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.052700 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.053511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.055138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.066821 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1330/2712] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:10.070831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.081098 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd701-02b3-4797-a83c-606c471709b7 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.087344 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.088056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.088340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.088617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.089454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.090977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0675a-0d4f-4388-a106-944d807fb339 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.102162 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1383/2713] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:10.106522 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.117156 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf93d8-33d8-4349-851a-49a06c24f2bd admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.121764 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.122635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.122918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.123194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] PATH_INFO: `/v3/projects/1a622a45bde44a23bfa5158120be58da/users/ac3747e0edf246b2a09b9e7d56ddd050/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.135737 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:10.139162 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a622a45bde44a23bfa5158120be58da, user_id=ac3747e0edf246b2a09b9e7d56ddd050, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.142011 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.156755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1331/2714] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:10 2022] PUT /identity/v3/projects/1a622a45bde44a23bfa5158120be58da/users/ac3747e0edf246b2a09b9e7d56ddd050/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:10.167107 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.167407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.167737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.194924 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] MFA Rules not processed for user `ac3747e0edf246b2a09b9e7d56ddd050`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:10.196212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:10.261163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1384/2715] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:10.265965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.330210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ffdd4-39c3-4d42-806f-b9ba24f242e8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.335118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.335847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.336137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.336420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.338414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.340450 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.374002 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1332/2716] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:10 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:10.375546 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.394731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9579-6c76-492f-a9bd-9709a9e673b8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.452886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.453560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.453841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.454115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.454930 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.456974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.479827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1385/2717] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:10 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:10.481378 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.493459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0675-c9dc-4247-8b5b-4df9ef0290ee admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.500262 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.500987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.501388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.501699 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.502437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.504784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.516516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1333/2718] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:10.520376 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.531444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febade0f-10f1-4702-80e1-0ad75db12f03 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.537703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.538566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.538817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.539188 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] PATH_INFO: `/v3/projects/fde16182e159437790a5e89a2d2f00a7/users/ead3aa749cb94db19c6b288521f9ad0a/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.555680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde16182e159437790a5e89a2d2f00a7, user_id=ead3aa749cb94db19c6b288521f9ad0a, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.558343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.571873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1386/2719] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:10 2022] PUT /identity/v3/projects/fde16182e159437790a5e89a2d2f00a7/users/ead3aa749cb94db19c6b288521f9ad0a/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:10.575942 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.586037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b002b6-8c49-4c63-ad01-31e9fc4e1b33 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.644021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.644621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.644916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.645197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.645982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.647635 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da89614-678c-4018-af38-ee7fa974eee2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.658575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1334/2720] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:10.665091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.680190 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0922c99-ec57-4e9c-a0e1-9b87293ca7ce admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.685032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.685917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.686198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.686468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] PATH_INFO: `/v3/projects/fde16182e159437790a5e89a2d2f00a7/users/ead3aa749cb94db19c6b288521f9ad0a/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.688659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde16182e159437790a5e89a2d2f00a7, user_id=ead3aa749cb94db19c6b288521f9ad0a, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.691343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.702645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1387/2721] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:10 2022] PUT /identity/v3/projects/fde16182e159437790a5e89a2d2f00a7/users/ead3aa749cb94db19c6b288521f9ad0a/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:10.714029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.714322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.714602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.742299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] MFA Rules not processed for user `ead3aa749cb94db19c6b288521f9ad0a`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:10.743531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:10.792437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:10.814761 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1335/2722] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:10.826307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.828133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:10.859746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:10.888426 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93148-bf16-4982-94f4-208f6bec8521 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:10.892148 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:10.892824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:10.893108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:10.893386 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:10.902772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:10.904261 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:10.915003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1388/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:10.985842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:10.996280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a91f-e407-427e-ab96-5ea482aab042 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:11.000210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:11.000895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:11.001203 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:11.001493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:11.064913 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:11.066409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e82d-072d-4ca9-812c-24ac3c761550 service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:11.075584 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1336/2724] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:11.336379 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:11.401217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872ffc-dee0-4945-994e-bb5bb9ec226f service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:11.405771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:11.406637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:11.406917 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:11.407191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] PATH_INFO: `/v3/users/ac3747e0edf246b2a09b9e7d56ddd050` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:11.408410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3747e0edf246b2a09b9e7d56ddd050)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:11.410925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:11.460298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3747e0edf246b2a09b9e7d56ddd050'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:11.467595 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3747e0edf246b2a09b9e7d56ddd050'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:11.481387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3747e0edf246b2a09b9e7d56ddd050'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:11.489047 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3747e0edf246b2a09b9e7d56ddd050'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:11.489749 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3747e0edf246b2a09b9e7d56ddd050'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:11.496570 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1389/2725] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:11 2022] DELETE /identity/v3/users/ac3747e0edf246b2a09b9e7d56ddd050 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:11.500530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:11.500756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:11.501041 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:11.519875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:11.520789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:11.583072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1337/2726] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:11.594639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:11.596396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:11.652368 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:11.656496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b003-9eba-4608-a28d-898e8a89fdfd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:11.661999 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:11.662640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:11.663071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:11.663486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:11.674233 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:11.676351 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:11.686587 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1390/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:12.193559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:12.194934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:12.207602 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409bacf-7fb0-4b08-9832-70f4ed2df7b3 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:12.213541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:12.214400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:12.214686 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:12.214964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] PATH_INFO: `/v3/projects/1a622a45bde44a23bfa5158120be58da` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:12.216198 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a622a45bde44a23bfa5158120be58da)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:12.218161 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:12.279948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a622a45bde44a23bfa5158120be58da', 'request_id': 'req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.287721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a622a45bde44a23bfa5158120be58da', 'request_id': 'req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.293615 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a622a45bde44a23bfa5158120be58da', 'request_id': 'req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.304875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] The token cache is being invalidate because project 1a622a45bde44a23bfa5158120be58da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:12.305172 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.305831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.307425 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1338/2728] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:12 2022] DELETE /identity/v3/projects/1a622a45bde44a23bfa5158120be58da => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:12.311599 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:12.321935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc3c5-a522-4440-8d56-d9a99757c89e service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:12.383429 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:12.384330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:12.384607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:12.384880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] PATH_INFO: `/v3/users/ead3aa749cb94db19c6b288521f9ad0a` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:12.386114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead3aa749cb94db19c6b288521f9ad0a)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:12.388362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:12.440961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead3aa749cb94db19c6b288521f9ad0a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.449179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead3aa749cb94db19c6b288521f9ad0a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.462993 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead3aa749cb94db19c6b288521f9ad0a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.470486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead3aa749cb94db19c6b288521f9ad0a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.471252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-3baf6483-f018-488d-8579-ae240668dc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead3aa749cb94db19c6b288521f9ad0a'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.478631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1391/2729] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:12 2022] DELETE /identity/v3/users/ead3aa749cb94db19c6b288521f9ad0a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:12.771921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:12.774725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:12.789983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f091e-cdc6-4c1e-a2d0-f3ea268edfce admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:12.797120 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:12.859389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:12.860303 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:12.860593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:12.860877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] PATH_INFO: `/v3/projects/fde16182e159437790a5e89a2d2f00a7` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:12.862119 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde16182e159437790a5e89a2d2f00a7)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:12.864585 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:12.914184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde16182e159437790a5e89a2d2f00a7', 'request_id': 'req-309115ea-ecfe-4c95-b604-01fbebe2b801'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.923296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde16182e159437790a5e89a2d2f00a7', 'request_id': 'req-309115ea-ecfe-4c95-b604-01fbebe2b801'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.930534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde16182e159437790a5e89a2d2f00a7', 'request_id': 'req-309115ea-ecfe-4c95-b604-01fbebe2b801'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.942333 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] The token cache is being invalidate because project fde16182e159437790a5e89a2d2f00a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:12.942649 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.943344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-309115ea-ecfe-4c95-b604-01fbebe2b801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:12.944963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1339/2730] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:12 2022] DELETE /identity/v3/projects/fde16182e159437790a5e89a2d2f00a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:12.949871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:12.950387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:12.950519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:12.969499 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:12.970731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:13.036650 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1392/2731] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:13.046380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.046672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.047010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.070575 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:13.071983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:13.080765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1340/2732] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:13.085222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.096228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7df61-4009-49cd-84d7-256eae3ec310 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.101914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.102583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.102882 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.103313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.104241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:58:13.104423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.106037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.114213 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:13.127313 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1393/2733] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:58:13.129948 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.140588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e0d0b-3488-4597-a887-11053e53a058 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.145619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.146665 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.147057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.147443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.148336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.151630 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.186460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1341/2734] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:13 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:13.191441 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.201871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07da08-c5b0-4585-86a8-ec479e173670 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.272304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.272876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.273165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.273451 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.274196 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.276174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.298537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1394/2735] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:13 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:58:13.302915 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.317519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6400-81d4-4b23-a50c-5b1f5a6c8e02 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.323403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.324245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.324596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.324918 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.325721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.327609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.341505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1342/2736] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:13.345330 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.356967 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f06dbe-4d73-4fa4-9c92-1a22ee652aed admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.362941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.364781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.365436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.365950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.366921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.369032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3aae8-9b36-426f-abc8-5e4d4145ac09 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.386571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1395/2737] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:13.391197 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.403062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff3a5-e000-4c29-b4ca-1594d3883169 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.411933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.412842 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.413128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.413404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] PATH_INFO: `/v3/projects/7f22354dac814c36a70139d4048dde81/users/41259c79a17547a9976076399fce3dc2/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.430209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f22354dac814c36a70139d4048dde81, user_id=41259c79a17547a9976076399fce3dc2, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.433069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.452060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1343/2738] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:13 2022] PUT /identity/v3/projects/7f22354dac814c36a70139d4048dde81/users/41259c79a17547a9976076399fce3dc2/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:13.454139 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c95f6-bd4b-4f82-9eed-7064198786e6 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.454399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c95f6-bd4b-4f82-9eed-7064198786e6 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.454662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c95f6-bd4b-4f82-9eed-7064198786e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.475373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cc3c95f6-bd4b-4f82-9eed-7064198786e6 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:13.476625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cc3c95f6-bd4b-4f82-9eed-7064198786e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:13.561607 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1396/2739] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:13.571317 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:13.573137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:13.618157 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:13.639790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8069-d28a-4f68-be2f-cc33b7cbb4c8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:13.644239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:13.644977 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:13.645329 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:13.645609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:13.657202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:13.665695 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:13.677637 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1344/2740] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:14.369975 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.370487 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.370604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.397740 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] MFA Rules not processed for user `41259c79a17547a9976076399fce3dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:14.398974 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:14.473578 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1397/2741] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:14.478354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.488852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a5901-4c15-4c3d-ada2-6b984cf2002d service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.493405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.494059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.494343 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.494623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.495324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.497247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.527307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1345/2742] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:14 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:14.532016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.544624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d6833-08b8-459d-884e-e5f1bfa0a01b None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.548897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:14.606880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.607583 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.607868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.608140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.608841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.610751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.630857 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1398/2743] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:14 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 14:58:14.635804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.646181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6df86-38c3-4fac-b186-cc10069ffb00 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.650816 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.651511 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.656834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.656834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.656834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.656834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.666549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1346/2744] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:14.670765 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.682175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65c334-a6ad-4217-8892-a6826da36c85 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.686890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.687821 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.688109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.688420 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] PATH_INFO: `/v3/projects/2d810f4a34434fcdac74faf0955fa60d/users/12f61f46b6734452854ff55a42451ad5/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.705890 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d810f4a34434fcdac74faf0955fa60d, user_id=12f61f46b6734452854ff55a42451ad5, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.708532 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.721226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1399/2745] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:14 2022] PUT /identity/v3/projects/2d810f4a34434fcdac74faf0955fa60d/users/12f61f46b6734452854ff55a42451ad5/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:14.725938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.736347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacdf61-b4f6-4e41-b5f9-5a6eb74db8a4 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.793660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.794336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.794622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.794901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.795663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.797257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfa22-1430-4e45-966f-a62de475a7e1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.808371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1347/2746] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:14.812592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:14.823262 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3d943-4c58-4b39-ad1a-62623743f195 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:14.827938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:14.828819 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:14.829104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:14.829382 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] PATH_INFO: `/v3/projects/2d810f4a34434fcdac74faf0955fa60d/users/12f61f46b6734452854ff55a42451ad5/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:14.831949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d810f4a34434fcdac74faf0955fa60d, user_id=12f61f46b6734452854ff55a42451ad5, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:14.834608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4c7fa-23f9-46d8-9b93-5e0916072184 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:14.845152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1400/2747] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:14 2022] PUT /identity/v3/projects/2d810f4a34434fcdac74faf0955fa60d/users/12f61f46b6734452854ff55a42451ad5/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:15.453885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:15.454186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:15.454471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:15.482014 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] MFA Rules not processed for user `12f61f46b6734452854ff55a42451ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:15.483230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:15.560296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1348/2748] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:15.570818 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:15.571337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:15.571437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:15.589563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] MFA Rules not processed for user `41259c79a17547a9976076399fce3dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:15.590858 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:15.649265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1401/2749] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 14:58:15.660930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:15.662322 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:15.692439 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:15.737549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8bf6-0909-42d6-bcf3-0bce8b6dcb91 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:15.743152 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:15.743840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:15.744129 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:15.744414 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:15.752399 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:15.754075 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:15.764237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1349/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:25.641113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=66,keystone:INSERT=5 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:25.759722 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=22 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:28.402251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:28.403712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:28.463459 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd0f6a-bb2d-41ba-84fe-4e60b3f78cc8 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:28.467025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:28.467706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:28.467987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:28.468264 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:28.478191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:28.479708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:28.489947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1402/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:38.485123 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=26 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:47.958514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:48.020407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8eff1-b48c-4339-852a-ed650285565d service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:48.025655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:48.026532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:48.026817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:48.027115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] PATH_INFO: `/v3/users/41259c79a17547a9976076399fce3dc2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:48.028405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41259c79a17547a9976076399fce3dc2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:48.030382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:48.078470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41259c79a17547a9976076399fce3dc2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.086390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41259c79a17547a9976076399fce3dc2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.099043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41259c79a17547a9976076399fce3dc2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.099733 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41259c79a17547a9976076399fce3dc2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.106658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41259c79a17547a9976076399fce3dc2'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.113003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1350/2752] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:47 2022] DELETE /identity/v3/users/41259c79a17547a9976076399fce3dc2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:48.288061 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:48.300154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b633f8-e391-40ff-a858-6d37adb556be service cinder] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:48.357891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:48.358671 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:48.358957 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:48.359236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] PATH_INFO: `/v3/projects/7f22354dac814c36a70139d4048dde81` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:48.360464 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f22354dac814c36a70139d4048dde81)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:48.362361 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:48.408169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f22354dac814c36a70139d4048dde81', 'request_id': 'req-929d01cf-4e59-44da-8b96-15c408236cf3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.416278 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f22354dac814c36a70139d4048dde81', 'request_id': 'req-929d01cf-4e59-44da-8b96-15c408236cf3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.421742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f22354dac814c36a70139d4048dde81', 'request_id': 'req-929d01cf-4e59-44da-8b96-15c408236cf3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.433084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] The token cache is being invalidate because project 7f22354dac814c36a70139d4048dde81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:48.433373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.434016 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.435586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1403/2753] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:48 2022] DELETE /identity/v3/projects/7f22354dac814c36a70139d4048dde81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:48.439576 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:48.441084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:48.455186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521246c0-6ec9-45cd-8b36-5f5179c93fe1 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:48.512081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:48.512954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:48.513260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:48.513573 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] PATH_INFO: `/v3/users/12f61f46b6734452854ff55a42451ad5` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:48.514808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f61f46b6734452854ff55a42451ad5)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:48.516895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:48.539474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:48.570712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f61f46b6734452854ff55a42451ad5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.578194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f61f46b6734452854ff55a42451ad5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.590216 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f61f46b6734452854ff55a42451ad5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.590853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f61f46b6734452854ff55a42451ad5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.597921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-dfc5498e-91ea-4081-99bc-b59b41acd871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f61f46b6734452854ff55a42451ad5'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.604251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1351/2754] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:58:48 2022] DELETE /identity/v3/users/12f61f46b6734452854ff55a42451ad5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:48.776482 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:48.778006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:48.791951 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d01cf-4e59-44da-8b96-15c408236cf3 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:48.848719 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:48.849582 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:48.849868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:48.850661 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] PATH_INFO: `/v3/projects/2d810f4a34434fcdac74faf0955fa60d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:48.851900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d810f4a34434fcdac74faf0955fa60d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:48.853820 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:48.888228 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:48.901730 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d810f4a34434fcdac74faf0955fa60d', 'request_id': 'req-53aae41e-0b50-48ef-a477-118fe86b96a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.909933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d810f4a34434fcdac74faf0955fa60d', 'request_id': 'req-53aae41e-0b50-48ef-a477-118fe86b96a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.916434 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d810f4a34434fcdac74faf0955fa60d', 'request_id': 'req-53aae41e-0b50-48ef-a477-118fe86b96a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.928709 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] The token cache is being invalidate because project 2d810f4a34434fcdac74faf0955fa60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:58:48.929109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.929759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-53aae41e-0b50-48ef-a477-118fe86b96a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:58:48.931296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1404/2755] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:58:48 2022] DELETE /identity/v3/projects/2d810f4a34434fcdac74faf0955fa60d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:48.936426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:48.936720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:48.937000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:48.955983 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:48.957185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:49.016154 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1352/2756] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:49.024250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.024547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.024836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.043415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:49.044631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:49.052642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1405/2757] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:49.057634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.067629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835ad7-08d6-4754-83c1-c5c093ee7c1c None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.072273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.072927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.073215 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.073493 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.074226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 14:58:49.074536 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.076180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.088404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1353/2758] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 14:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 14:58:49.092860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.102918 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d66541-ac23-422b-ab87-0e1d4528000a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.107622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.108277 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.108562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.108842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.109538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.111439 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.146497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1406/2759] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 14:58:49 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:49.151311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.161479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd0c3c-fff8-49af-a2c3-2f09ceafdb24 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.220236 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.220905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.221191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.221470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.222204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.224433 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.245757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1354/2760] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 14:58:49 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 14:58:49.250049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.260496 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda30c-9518-4bcd-9eb5-71ba01e0155f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.265122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.265875 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.266158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.266436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.267169 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.268797 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.279173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1407/2761] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:49.283257 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.293750 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085884-e2d4-4ee1-9df5-d81356ab3806 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.298421 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.299073 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.299356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.299663 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.300386 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.301965 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629b19-7836-420a-a4b0-753498738994 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.311841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1355/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 14:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 14:58:49.315881 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.326056 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acef87-5a39-433e-8c8f-b32f6027081c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.330976 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.331885 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.332177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.332489 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] PATH_INFO: `/v3/projects/f1a4d3a00e6642949b688847ba672487/users/09a15e801e28497e85df1612d8a87138/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.347997 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4d3a00e6642949b688847ba672487, user_id=09a15e801e28497e85df1612d8a87138, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.351673 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.364707 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1408/2763] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 14:58:49 2022] PUT /identity/v3/projects/f1a4d3a00e6642949b688847ba672487/users/09a15e801e28497e85df1612d8a87138/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:58:49.375342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.375685 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.376021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.383540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:49.404707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] MFA Rules not processed for user `09a15e801e28497e85df1612d8a87138`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:58:49.405927 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:49.470997 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1356/2764] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:58:49.482437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:58:49.484273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:58:49.543176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f942a1-9517-4a2a-bdf5-32c003b10a55 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:58:49.546880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:58:49.547571 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:58:49.547862 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:58:49.548143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:58:49.557897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:58:49.560335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1065c2-8698-4f52-9c85-ef3d3dc80639 service glance] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:58:49.573034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1409/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:58:59.467854 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=30 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:58:59.566272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=69,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:59:08.177442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:08.241625 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989edce1-a21f-4178-8c38-bb27995c0de1 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:08.246806 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:08.247701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:08.247989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:08.248267 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] PATH_INFO: `/v3/users/09a15e801e28497e85df1612d8a87138` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:08.249479 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a15e801e28497e85df1612d8a87138)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:08.251560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:08.297307 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a15e801e28497e85df1612d8a87138'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.304692 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a15e801e28497e85df1612d8a87138'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.317624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a15e801e28497e85df1612d8a87138'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.318281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a15e801e28497e85df1612d8a87138'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.325083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a15e801e28497e85df1612d8a87138'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.330980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1357/2766] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 14:59:08 2022] DELETE /identity/v3/users/09a15e801e28497e85df1612d8a87138 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:59:08.335523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:08.336029 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:08.336131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:08.354122 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 14:59:08.355335 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:08.415521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1410/2767] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 14:59:08.425306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:08.426734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:08.490242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48eb99-5b4d-4064-83cf-89eb1c45c22b admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:08.494698 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:08.495345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:08.495672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:08.495951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:08.505301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:08.506743 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:08.516756 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1358/2768] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:59:08.782059 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:08.783559 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:08.797269 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b43d9-2f97-44d2-8264-e856f894e90a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:08.802182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:08.803070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:08.803355 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:08.803665 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] PATH_INFO: `/v3/projects/f1a4d3a00e6642949b688847ba672487` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:08.804899 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a4d3a00e6642949b688847ba672487)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:08.807541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:08.855679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a4d3a00e6642949b688847ba672487', 'request_id': 'req-506731d7-6d7a-46e7-97c7-28ce222811fc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.863198 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a4d3a00e6642949b688847ba672487', 'request_id': 'req-506731d7-6d7a-46e7-97c7-28ce222811fc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.869425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a4d3a00e6642949b688847ba672487', 'request_id': 'req-506731d7-6d7a-46e7-97c7-28ce222811fc'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.880471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] The token cache is being invalidate because project f1a4d3a00e6642949b688847ba672487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 14:59:08.880768 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.881414 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 14:59:08.882971 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1411/2769] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 14:59:08 2022] DELETE /identity/v3/projects/f1a4d3a00e6642949b688847ba672487 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 14:59:18.512181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:59:18.877413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:59:31.011530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:31.012958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:31.070001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6214c9-494b-4f39-80da-1c0a10bd42fe service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:31.117711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:31.118375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:31.118666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:31.118947 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:31.120778 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:31.191563 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:31.193009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:31.204044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1359/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:59:34.988436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:34.989906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:35.047933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 14:59:35.054380 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506731d7-6d7a-46e7-97c7-28ce222811fc admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:35.058451 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428db-f3db-497e-9c1d-e57be404fcbf service cinder] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 14:59:35.058790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:35.059468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:35.059836 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:35.060113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:35.061929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:35.063870 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 14:59:35.064597 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 14:59:35.064898 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 14:59:35.065183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 14:59:35.066993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 14:59:35.078495 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:35.078671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 14:59:35.080063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:35.080249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 14:59:35.090102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1360/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:59:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 14:59:35.092054 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1412/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 14:59:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 14:59:45.085164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=80 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 14:59:45.086716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=26 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:02:06.436264 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:06.438730 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:06.460514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7378119-487c-492f-b8b3-30869756dcda service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:06.470390 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:06.471069 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:06.471366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:06.471675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:06.473567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:06.488184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:06.489966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bef4a-cd0d-405b-9c16-a22196b61d1d service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:06.503634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1361/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:06.576066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:06.577497 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:06.659716 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e599ad-4f01-4853-a487-3d0f98cb47f2 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:06.666303 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:06.667146 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:06.667563 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:06.667950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:06.670538 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:06.684291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:06.685949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:06.697158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1413/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:10.067982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:10.068517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:10.068517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:10.086616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] MFA Rules not processed for user `557eef8a9358467c89d0b53cf7804264`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:02:10.087852 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:10.148077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1362/2775] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:02:10.451304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:10.460737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea3871-30b0-432b-a3c4-f26e78b2f587 service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:10.465020 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:10.465658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:10.465944 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:10.466221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:10.468068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:10.477718 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:10.479404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:10.487527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1414/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:11.823832 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:11.825217 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:11.840285 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e72e-af6f-4a17-ac43-6153a8602603 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:11.845327 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:11.845987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:11.846273 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:11.846551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:11.848354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:11.861311 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:11.862901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:11.874179 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1363/2777] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:19.831537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:19.847177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0eea9-1072-4a51-8317-5d5363e16924 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:19.853448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:19.854133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:19.854446 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:19.854726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:19.857085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:19.870308 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:19.871947 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:19.887070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1415/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:21.868812 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=37 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:02:23.709168 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:02:23.710681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:23.726566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687939-3cfc-47a2-bda5-d0f9b7f56d51 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:02:23.732711 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:02:23.733424 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:02:23.733704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:02:23.733982 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:02:23.736442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:02:23.750531 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:02:23.752448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:02:23.765444 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1364/2779] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:02:29.878642 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=44 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:02:33.759502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:28.326832 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:28.338963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eb6ea-0c8d-48ea-a99c-66d0599e66cd service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:28.344455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:28.345754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:28.346040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:28.346317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:28.348179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:28.359032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:28.360640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:28.369617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1416/2780] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:38.365609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=6 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:48.454384 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:48.464128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e549c2-9a2f-4fcf-83c2-8c7a1aafa02b service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:48.467787 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:48.468431 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:48.468718 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:48.469000 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:48.470789 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:48.536184 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:48.537662 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:48.547701 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1365/2781] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:51.394025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:51.414130 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef54d-9ce8-4157-b52f-1a07486af562 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:51.419346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:51.420105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:51.420400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:51.420759 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:51.422640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:51.436481 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:51.439714 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:51.448888 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:51.450706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:51.451619 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1417/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:51.463610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e51a7c-ff1a-44ea-b241-dbc1cb18a184 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:51.469904 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:51.471304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:51.471633 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:51.471911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] PATH_INFO: `/v3/users/557eef8a9358467c89d0b53cf7804264` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:51.473841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557eef8a9358467c89d0b53cf7804264)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:51.476038 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:51.531652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557eef8a9358467c89d0b53cf7804264'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.540160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557eef8a9358467c89d0b53cf7804264'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.552672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557eef8a9358467c89d0b53cf7804264'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.553320 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557eef8a9358467c89d0b53cf7804264'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.560160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-eb150647-ffed-43be-9756-64eff0c2c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557eef8a9358467c89d0b53cf7804264'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.566142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1366/2783] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:03:51 2022] DELETE /identity/v3/users/557eef8a9358467c89d0b53cf7804264 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:51.745158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:51.756428 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71b5d-5e15-4cb7-98bf-983cb1ebfe13 service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:51.825745 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:51.826728 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:51.827003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:51.827289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] PATH_INFO: `/v3/projects/757ea32b338942098a62aefec29dbf17` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:51.828677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757ea32b338942098a62aefec29dbf17)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:51.830786 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:51.883364 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757ea32b338942098a62aefec29dbf17', 'request_id': 'req-12fd9204-0567-4907-bd82-31c5d5f0a362'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.899025 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757ea32b338942098a62aefec29dbf17', 'request_id': 'req-12fd9204-0567-4907-bd82-31c5d5f0a362'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.905954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757ea32b338942098a62aefec29dbf17', 'request_id': 'req-12fd9204-0567-4907-bd82-31c5d5f0a362'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.917370 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] The token cache is being invalidate because project 757ea32b338942098a62aefec29dbf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:03:51.917666 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.918407 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-12fd9204-0567-4907-bd82-31c5d5f0a362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:51.920164 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1418/2784] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:03:51 2022] DELETE /identity/v3/projects/757ea32b338942098a62aefec29dbf17 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:51.925166 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:51.925465 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:51.926892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:51.946675 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:51.947935 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:52.007035 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1367/2785] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:52.014726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.015017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.015298 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.033306 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:52.034505 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:52.042659 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1419/2786] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:52.046989 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.057373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976831f-be1c-4506-8b22-a56875e1db02 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.062158 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.062824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.063112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.063396 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.064196 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:03:52.064513 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.066151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.068194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:52.081951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1368/2787] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:03:52.086174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.098604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad72a-fb07-4971-8f13-941f082bb454 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.103627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.104305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.104592 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.104869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.105843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.107810 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.137039 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1420/2788] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:03:52 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:52.141365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.151784 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ed18-0aab-4ca3-8ea8-cfe22b680772 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.209405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.210084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.210373 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.210654 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.211360 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.213306 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.234337 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1369/2789] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:03:52 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:52.238560 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.250301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8b9b5-2e71-4e5e-8eda-f49b96eb02ef admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.254954 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.255646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.255939 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.256222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.256961 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.258556 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.269337 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1421/2790] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:52.273286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.283389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc77d4-840c-4d3f-9786-31e51bbfe9f1 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.288594 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.289252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.289540 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.289817 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.290547 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.292205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67866e-cc2e-49ac-892a-28049eee7c6f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.303107 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1370/2791] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:52.307744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.318485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421368f0-edb9-4d36-9362-5ff5db3e4c9c admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.323141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.324043 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.324329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.324610 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] PATH_INFO: `/v3/projects/fc1492f5737c4f25b35107e76e21d1be/users/44d0b62002e44c5690d7e8009c95a9d7/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.339639 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1492f5737c4f25b35107e76e21d1be, user_id=44d0b62002e44c5690d7e8009c95a9d7, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.342222 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.356628 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1422/2792] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:03:52 2022] PUT /identity/v3/projects/fc1492f5737c4f25b35107e76e21d1be/users/44d0b62002e44c5690d7e8009c95a9d7/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:52.368295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.368587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.368869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.401430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] MFA Rules not processed for user `44d0b62002e44c5690d7e8009c95a9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:52.402458 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:52.481825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1371/2793] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:52.496982 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:52.498843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:52.514960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:52.577244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b99cd1-8ca8-4716-8152-22d9cf9ab450 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:52.582803 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:52.583465 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:52.583767 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:52.584044 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:52.591914 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:52.593437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1d6cb-50ed-467a-a384-644063fbdce3 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:52.602221 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1423/2794] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:55.299266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:55.359423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d621-c266-4a7c-a504-07e339c159f2 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:55.364185 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:55.365001 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:55.365287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:55.365566 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] PATH_INFO: `/v3/users/44d0b62002e44c5690d7e8009c95a9d7` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:55.366770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d0b62002e44c5690d7e8009c95a9d7)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:55.368781 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:55.371178 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:55.419696 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d0b62002e44c5690d7e8009c95a9d7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:55.427136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d0b62002e44c5690d7e8009c95a9d7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:55.439239 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d0b62002e44c5690d7e8009c95a9d7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:55.439910 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d0b62002e44c5690d7e8009c95a9d7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:55.447132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d0b62002e44c5690d7e8009c95a9d7'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:55.452926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1372/2795] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:03:55 2022] DELETE /identity/v3/users/44d0b62002e44c5690d7e8009c95a9d7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:55.458179 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:55.458649 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:55.458746 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:55.476114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:55.477417 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:55.558454 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1424/2796] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:55.568844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:55.570244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:55.627639 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906648f-5146-4aa7-aaa7-b585794d7717 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:55.631877 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:55.632765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:55.632900 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:55.633089 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:55.642572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:55.644139 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb77f7-8265-403b-a675-dfdcfb9a4bd8 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:55.654182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1373/2797] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:55.927627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:55.929180 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:55.943285 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628556a3-b0bc-4a91-89f3-4159f1ef6c22 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:55.948199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:55.949071 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:55.949354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:55.949633 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] PATH_INFO: `/v3/projects/fc1492f5737c4f25b35107e76e21d1be` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:55.950831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1492f5737c4f25b35107e76e21d1be)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:55.953643 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.001835 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1492f5737c4f25b35107e76e21d1be', 'request_id': 'req-5adac535-fbff-4c31-acd7-79ecfd07d4e7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:56.009703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1492f5737c4f25b35107e76e21d1be', 'request_id': 'req-5adac535-fbff-4c31-acd7-79ecfd07d4e7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:56.015281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1492f5737c4f25b35107e76e21d1be', 'request_id': 'req-5adac535-fbff-4c31-acd7-79ecfd07d4e7'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:56.027064 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] The token cache is being invalidate because project fc1492f5737c4f25b35107e76e21d1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:03:56.027354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:56.028017 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-5adac535-fbff-4c31-acd7-79ecfd07d4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:56.029555 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1425/2798] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:03:55 2022] DELETE /identity/v3/projects/fc1492f5737c4f25b35107e76e21d1be => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:56.034494 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.034790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.035072 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.052971 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:56.054234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:56.115532 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1374/2799] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:56.123435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.123747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.124035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.143074 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:56.144318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:56.153091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1426/2800] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:56.157448 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.167380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632d0f-7daf-498e-9668-bfd384cf2943 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.172046 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.172703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.172991 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.173272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.174015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:03:56.174324 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.176004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.188127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1375/2801] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:03:56.193147 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.202547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c8fca-2f27-4cd6-8c01-7db932d36c6f None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.207850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.208521 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.208806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.209115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.209825 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.211764 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.225910 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:56.242035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1427/2802] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:03:56 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:56.246363 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.256312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072b2a-76e9-47e6-a01d-4b9a250626b7 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.263891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:56.315077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.315805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.316062 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.316344 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.317052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.318990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.341682 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1376/2803] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:03:56 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:56.346325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.357853 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b87c-c7d7-4133-8733-3b5fe0c402e6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.362508 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.363173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.363519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.363805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.364543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.366143 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.376627 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1428/2804] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:56.380729 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.391222 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea66f80-c098-4972-b7b0-a9a1fb9e716c admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.396456 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.397124 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.397417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.397708 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.398440 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.400078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2d1d4-9a35-4256-8308-697a5ba21983 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.410201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1377/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:56.414946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.425013 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8b6f-705b-4ffd-bfac-7ba4196bd042 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.429697 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.430575 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.430856 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.431133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] PATH_INFO: `/v3/projects/e82e19713e8e44fc812b6a6c1bcc9e3b/users/1f487173161d45938d26e127f20a4970/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.446752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82e19713e8e44fc812b6a6c1bcc9e3b, user_id=1f487173161d45938d26e127f20a4970, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.449457 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.463528 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1429/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:03:56 2022] PUT /identity/v3/projects/e82e19713e8e44fc812b6a6c1bcc9e3b/users/1f487173161d45938d26e127f20a4970/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:56.477009 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.477310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.477593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.503819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] MFA Rules not processed for user `1f487173161d45938d26e127f20a4970`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:56.505024 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:56.568831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1378/2807] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:56.579817 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.581640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:56.655579 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba06a-56a5-4f48-830a-31f9fbf3962f admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.661214 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.661796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.662084 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.662363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.670216 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.671837 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193aafc-5824-4c2d-8244-43e4a2fbd700 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.680669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1430/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:56.887702 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:56.950831 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50861-49bd-42be-9330-bc4e89e0ff50 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:56.955437 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:56.956328 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:56.956619 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:56.956899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] PATH_INFO: `/v3/users/1f487173161d45938d26e127f20a4970` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:56.958109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f487173161d45938d26e127f20a4970)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:56.960081 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:56.983403 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:57.010331 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f487173161d45938d26e127f20a4970'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.017515 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f487173161d45938d26e127f20a4970'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.030183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f487173161d45938d26e127f20a4970'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.030824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f487173161d45938d26e127f20a4970'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.038362 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f487173161d45938d26e127f20a4970'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.044277 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1379/2809] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:03:56 2022] DELETE /identity/v3/users/1f487173161d45938d26e127f20a4970 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:03:57.048743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.049031 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.049309 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.065921 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:57.067144 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:57.126410 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1431/2810] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:57.136287 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.137660 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:57.195401 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a98c-d62b-46b1-a296-295b24e820d7 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.199133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.199819 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.200110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.200393 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.210600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.212037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003e40a-a6d5-46e5-9aaa-e2e71464056a service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.222042 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1380/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:57.488618 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.490175 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:57.506183 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2bee-dba5-4070-853a-cbcd9a6155b3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.511040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.512018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.512450 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.512842 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] PATH_INFO: `/v3/projects/e82e19713e8e44fc812b6a6c1bcc9e3b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.514352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82e19713e8e44fc812b6a6c1bcc9e3b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.516265 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.557654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:57.566149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82e19713e8e44fc812b6a6c1bcc9e3b', 'request_id': 'req-6fda75c3-350b-46b7-8b90-61fc87d24660'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.574504 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82e19713e8e44fc812b6a6c1bcc9e3b', 'request_id': 'req-6fda75c3-350b-46b7-8b90-61fc87d24660'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.581109 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82e19713e8e44fc812b6a6c1bcc9e3b', 'request_id': 'req-6fda75c3-350b-46b7-8b90-61fc87d24660'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.592920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] The token cache is being invalidate because project e82e19713e8e44fc812b6a6c1bcc9e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:03:57.593218 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.593872 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6fda75c3-350b-46b7-8b90-61fc87d24660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:57.595425 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1432/2812] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:03:57 2022] DELETE /identity/v3/projects/e82e19713e8e44fc812b6a6c1bcc9e3b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:57.600963 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.601472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.601574 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.620077 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:57.621334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:57.679905 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1381/2813] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:57.689100 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.689398 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.689686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.707946 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:57.709161 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:57.717245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1433/2814] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:57.721452 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.732235 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d90f4c-7528-4dd7-9ea4-3a1faf121e33 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.736804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.737460 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.737745 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.738030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.739298 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:03:57.739648 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.741290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.752843 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1382/2815] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:03:57.757138 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.766572 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb3ff-5761-4fbb-8a81-a1c4a0ce0439 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.771850 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.772503 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.772790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.773070 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.773838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.775771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.802291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1434/2816] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:03:57 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:57.806487 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.817086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8120fce-ab48-43e7-b4fb-3e614f79606a admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.842339 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:57.874592 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.875272 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.875600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.875884 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.876596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.878509 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.902508 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1383/2817] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:03:57 2022] POST /identity/v3/users => generated 280 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:57.903948 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.915203 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedbba0-0df8-45af-8588-173ac4fdf9e6 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.920421 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.921104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.921392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.921674 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.922419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.924114 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.936291 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1435/2818] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:57.940541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.951549 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5a44-49de-4f25-a527-07ee023432b0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.956582 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.956940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.957389 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.957747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:57.958410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:57.960036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61bbef-a271-49b3-817c-bb44ffd15de7 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:57.971088 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1384/2819] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:57.975343 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:57.986079 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7de34-414c-46df-a849-e3ac371aeca4 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:57.991280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:57.992182 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:57.992472 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:57.992752 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] PATH_INFO: `/v3/projects/1b3b960906574ef8b5c71e89863cc85c/users/5380bad1b9fa4c31b30fe9f6ff33af70/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.007956 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3b960906574ef8b5c71e89863cc85c, user_id=5380bad1b9fa4c31b30fe9f6ff33af70, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:58.010688 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:58.024117 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1436/2820] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:03:57 2022] PUT /identity/v3/projects/1b3b960906574ef8b5c71e89863cc85c/users/5380bad1b9fa4c31b30fe9f6ff33af70/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:58.034528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.034886 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.035296 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.062055 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] MFA Rules not processed for user `5380bad1b9fa4c31b30fe9f6ff33af70`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:58.063275 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:58.130061 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1385/2821] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:58.161870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:58.163695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:58.221617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0808a0-262a-4bdb-b668-4d2fefd1ae05 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:58.225399 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:58.226052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.226340 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.226621 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.235223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:58.236742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2dc1b-ab8c-49ad-a732-89203d92a275 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:58.246565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1437/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:03:58.260827 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:58.322609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7693b-6ba0-4cf7-b7e8-716340e141a5 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:58.327336 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:58.328231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.328523 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.328804 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] PATH_INFO: `/v3/users/5380bad1b9fa4c31b30fe9f6ff33af70` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.330021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5380bad1b9fa4c31b30fe9f6ff33af70)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:58.331985 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:58.373394 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:58.381426 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5380bad1b9fa4c31b30fe9f6ff33af70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.388616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5380bad1b9fa4c31b30fe9f6ff33af70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.401822 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5380bad1b9fa4c31b30fe9f6ff33af70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.402623 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5380bad1b9fa4c31b30fe9f6ff33af70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.409517 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5380bad1b9fa4c31b30fe9f6ff33af70'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.415590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1386/2823] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:03:58 2022] DELETE /identity/v3/users/5380bad1b9fa4c31b30fe9f6ff33af70 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:58.420224 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.420512 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.420789 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.437662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:58.438893 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:58.502706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1438/2824] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:58.513006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:58.514514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:58.573664 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98697-8ee9-4054-ad4d-35c03ebebedc admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:58.577725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:58.578704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.579074 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.579629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.591010 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:58.592462 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37dba3-096e-4cea-8859-bbf7c995dc44 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:58.602380 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1387/2825] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:03:58.876471 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:58.877932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:58.892791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88306fe4-5d3f-4488-918a-c8e06e5bba69 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:58.897756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:58.898636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.898942 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.899250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] PATH_INFO: `/v3/projects/1b3b960906574ef8b5c71e89863cc85c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:58.900690 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3b960906574ef8b5c71e89863cc85c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:58.902529 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:58.904389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:58.957519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3b960906574ef8b5c71e89863cc85c', 'request_id': 'req-6b9da814-621e-48d2-981d-5b90fc275161'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.965092 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3b960906574ef8b5c71e89863cc85c', 'request_id': 'req-6b9da814-621e-48d2-981d-5b90fc275161'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.970654 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3b960906574ef8b5c71e89863cc85c', 'request_id': 'req-6b9da814-621e-48d2-981d-5b90fc275161'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.983384 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] The token cache is being invalidate because project 1b3b960906574ef8b5c71e89863cc85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:03:58.983713 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.984374 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-6b9da814-621e-48d2-981d-5b90fc275161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:03:58.986259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1439/2826] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:03:58 2022] DELETE /identity/v3/projects/1b3b960906574ef8b5c71e89863cc85c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:03:58.991951 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:58.992249 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:58.992533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.011286 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:59.012476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:59.070829 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1388/2827] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:59.078554 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.078846 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.079129 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.097248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:59.098473 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:59.106608 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1440/2828] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:59.110844 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.121612 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab2f5-de3a-4283-8996-1bd0cd26fcdc None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.126299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.126958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.127247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.127560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.128302 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:03:59.128645 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.130744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.142326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1389/2829] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:03:59.147329 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.156941 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c82c67-e8a3-40d1-a857-5dbe2fa69a04 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.161681 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.162389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.162680 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.162980 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.163741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.165636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.192232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1441/2830] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:03:59 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:59.196420 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.206464 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2251-b4d0-4f5a-a20b-ecff3b54ae5e admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.252503 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:03:59.269466 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.271044 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.271567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.272006 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.273183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.275818 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.299506 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1390/2831] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:03:59 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:03:59.303712 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.313865 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c839-5b5c-4041-b48c-43c3a0f8f763 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.318486 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.319128 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.319413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.319715 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.320442 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.322015 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.331938 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1442/2832] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:59.336388 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.346412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5083-376d-46e2-a1e9-9fb39269fc09 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.351790 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.352455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.352744 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.353030 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.353766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.355655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64feac-fe62-467c-a19c-87d6f30eab7c admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.365613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1391/2833] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:03:59.369637 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.379758 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e50b2a-aead-4c2b-9681-82f9c3394f66 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.384412 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.385281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.385584 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.386158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] PATH_INFO: `/v3/projects/dbfe6d1ab5c94a038ca4210603fb6ac3/users/f87b062ba4ea4bd1ba6e7092eae26536/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.402273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfe6d1ab5c94a038ca4210603fb6ac3, user_id=f87b062ba4ea4bd1ba6e7092eae26536, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.405037 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.418731 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1443/2834] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:03:59 2022] PUT /identity/v3/projects/dbfe6d1ab5c94a038ca4210603fb6ac3/users/f87b062ba4ea4bd1ba6e7092eae26536/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:03:59.430037 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.430330 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.430609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.458916 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] MFA Rules not processed for user `f87b062ba4ea4bd1ba6e7092eae26536`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:03:59.460194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:59.526775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1392/2835] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:03:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:03:59.538880 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:03:59.540799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:03:59.597647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546af8-074d-4c37-9aea-e5d19ddfcb16 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:03:59.602220 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:03:59.602871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:03:59.603154 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:03:59.603431 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:03:59.612436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:03:59.614003 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef38d4-f1dd-4921-84d1-d35661a145de service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:03:59.622968 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1444/2836] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:09.523754 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:09.618841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:10.967567 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.038054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57690b78-f1da-4ae1-b3f3-1655a20f1d8b None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.042869 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.043779 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.044071 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.044359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] PATH_INFO: `/v3/users/f87b062ba4ea4bd1ba6e7092eae26536` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.046734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87b062ba4ea4bd1ba6e7092eae26536)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.048709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:11.099966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87b062ba4ea4bd1ba6e7092eae26536'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.107808 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87b062ba4ea4bd1ba6e7092eae26536'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.120539 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87b062ba4ea4bd1ba6e7092eae26536'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.121208 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87b062ba4ea4bd1ba6e7092eae26536'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.128095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87b062ba4ea4bd1ba6e7092eae26536'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.134610 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1393/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:04:10 2022] DELETE /identity/v3/users/f87b062ba4ea4bd1ba6e7092eae26536 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:11.139082 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.139586 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.139686 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.156902 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:11.158104 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:11.216067 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1445/2838] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:11.226441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.227954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:11.286106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dcb31-19ea-4b62-8af0-400ff295c87f admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.289966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.290627 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.290912 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.291193 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.300459 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.302560 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad730d-d206-4df0-9c7b-7749ad4c7df7 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:11.312095 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1394/2839] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:11.587662 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.589124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:11.602622 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74880347-c176-40ff-bf3d-e5b2ef8a8ce9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.608636 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.609604 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.610055 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.610432 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] PATH_INFO: `/v3/projects/dbfe6d1ab5c94a038ca4210603fb6ac3` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.612166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfe6d1ab5c94a038ca4210603fb6ac3)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.615588 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:11.663254 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfe6d1ab5c94a038ca4210603fb6ac3', 'request_id': 'req-7432afd8-8627-43e9-b128-11fca11351a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.672038 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfe6d1ab5c94a038ca4210603fb6ac3', 'request_id': 'req-7432afd8-8627-43e9-b128-11fca11351a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.678771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfe6d1ab5c94a038ca4210603fb6ac3', 'request_id': 'req-7432afd8-8627-43e9-b128-11fca11351a3'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.690919 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] The token cache is being invalidate because project dbfe6d1ab5c94a038ca4210603fb6ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:04:11.691244 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.691963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-7432afd8-8627-43e9-b128-11fca11351a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:11.693566 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1446/2840] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:04:11 2022] DELETE /identity/v3/projects/dbfe6d1ab5c94a038ca4210603fb6ac3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:11.698538 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.698908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.699189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.718933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:11.720155 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:11.737417 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:11.780782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1395/2841] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:11.789184 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.789475 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.789757 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.807923 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:11.809140 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:11.817108 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1447/2842] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:11.821258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.831108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b633eed-3c19-4d94-ab02-e51b17ee45b4 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.836321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.836984 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.837274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.837557 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.838295 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:04:11.838608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.840261 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:11.852402 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1396/2843] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:04:11.857242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.866711 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf6f5-1b26-4a30-b01a-222bcba9e050 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.871405 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.872091 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.872377 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.872655 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.873365 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.875259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:11.901168 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1448/2844] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:04:11 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:04:11.908938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:11.920143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ac1d-b9ce-4884-81e0-605a8c82f5e3 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:11.976409 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:11.977136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:11.977365 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:11.977647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:11.978353 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:11.980305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:12.000757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1397/2845] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:04:11 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:04:12.005527 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:12.016036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7ad1-9b24-410a-8908-d49adc101efc admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:12.021116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:12.021771 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:12.022053 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:12.022328 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:12.023057 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:12.024678 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:12.034906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1449/2846] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:12.038901 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:12.049190 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfda60-6563-420b-9a18-544571cca986 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:12.054529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:12.055205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:12.055534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:12.055824 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:12.056565 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:12.058176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf77fbc-88b5-4c80-98a2-007a6be6d58a admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:12.068873 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1398/2847] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:12.073266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:12.083911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f77da-bfca-4d56-8f10-0160f7870693 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:12.088870 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:12.089742 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:12.090019 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:12.090296 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] PATH_INFO: `/v3/projects/3b87dd1262694cffbcb9461cc98a455d/users/12a04a5b75b341038474cf78f217347f/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:12.105178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b87dd1262694cffbcb9461cc98a455d, user_id=12a04a5b75b341038474cf78f217347f, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:12.108113 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:12.120601 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1450/2848] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:04:12 2022] PUT /identity/v3/projects/3b87dd1262694cffbcb9461cc98a455d/users/12a04a5b75b341038474cf78f217347f/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:12.131371 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:12.131709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:12.132003 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:12.159005 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] MFA Rules not processed for user `12a04a5b75b341038474cf78f217347f`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:12.160305 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:12.231084 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1399/2849] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:12.241965 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:12.244251 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:12.267006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:12.303523 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdac97-703f-4497-98b0-9ea81ffd4ccd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:12.307236 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dae0c98ee06544579ca6cdbe1163a028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:12.307911 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:12.308197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:12.308485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:12.317395 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:12.318824 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797643-ad78-41bb-839c-06412bbd3740 service cinder] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:12.327699 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1451/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:22.129400 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:22.148895 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:22.199551 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e5e2-766b-4e39-95a5-0eb10a30b033 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:22.204230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:22.205108 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.205392 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.205670 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] PATH_INFO: `/v3/users/12a04a5b75b341038474cf78f217347f` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.206885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a04a5b75b341038474cf78f217347f)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:22.210164 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:22.259021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a04a5b75b341038474cf78f217347f'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.266545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a04a5b75b341038474cf78f217347f'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.279160 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a04a5b75b341038474cf78f217347f'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.279826 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a04a5b75b341038474cf78f217347f'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.287304 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a04a5b75b341038474cf78f217347f'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.293252 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1400/2851] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:04:22 2022] DELETE /identity/v3/users/12a04a5b75b341038474cf78f217347f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:22.297805 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.298326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.298438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.315149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:22.316397 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:22.374519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1452/2852] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:22.384127 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:22.385636 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:22.445028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266812-18fe-4d0e-b2da-601514063d65 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:22.448712 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:22.449361 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.449647 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.449930 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.460232 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:22.461707 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130d5e-9f74-4b17-97c0-f194d2398d64 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:22.471412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1401/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:22.750494 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:22.751964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:22.767131 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e46-1047-40a8-b7fd-87ee1d505d44 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:22.772994 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:22.774034 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.774323 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.774598 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] PATH_INFO: `/v3/projects/3b87dd1262694cffbcb9461cc98a455d` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.775844 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b87dd1262694cffbcb9461cc98a455d)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:22.777935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:22.827600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b87dd1262694cffbcb9461cc98a455d', 'request_id': 'req-456e02fb-4b5a-4c57-ad1a-e752d5344584'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.841394 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b87dd1262694cffbcb9461cc98a455d', 'request_id': 'req-456e02fb-4b5a-4c57-ad1a-e752d5344584'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.847897 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b87dd1262694cffbcb9461cc98a455d', 'request_id': 'req-456e02fb-4b5a-4c57-ad1a-e752d5344584'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.859669 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] The token cache is being invalidate because project 3b87dd1262694cffbcb9461cc98a455d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92083) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:04:22.859964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.860632 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-456e02fb-4b5a-4c57-ad1a-e752d5344584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:04:22.862191 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1453/2854] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:04:22 2022] DELETE /identity/v3/projects/3b87dd1262694cffbcb9461cc98a455d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:22.867689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.867990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.868280 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.886867 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:22.888099 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:22.922658 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:22.952052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1402/2855] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:22.959932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:22.960226 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:22.960513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:22.979163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:22.980483 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:22.988751 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1454/2856] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:22.993463 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.003579 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d698-e83a-4f10-966d-eb41a459d968 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.008954 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.009616 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.009906 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.010188 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] PATH_INFO: `/v3/domains` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.010928 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:04:23.011243 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.012894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.024716 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1403/2857] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:04:23.029035 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.038576 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82b83-28d5-4f30-b448-ec1d917efc7a None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.043435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.044136 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.044423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.044702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.045396 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.047314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.074124 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1455/2858] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:04:23.078278 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.091284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60901aa-68b1-4f9b-a6d8-126922114923 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.155338 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.156079 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.156308 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.156588 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.157472 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.159478 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.181170 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1404/2859] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:04:23 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:04:23.185252 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.196314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2107-8907-42a5-ae28-beb985f9eabb admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.200990 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.201648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.201933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.202209 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.202945 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.204580 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.216166 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1456/2860] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:23.220340 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.231519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea09e-c1d2-4fea-a9b7-c68d71d2b0d8 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.236231 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.236892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.237183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.237469 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.238205 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.240528 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b64ab-0ed7-4d21-9f86-24d72bcf6474 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.254442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1405/2861] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:23.255708 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.265596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cea16-a01f-48f5-8ba8-9f671d933ed5 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.270223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.271093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.271371 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.271675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] PATH_INFO: `/v3/projects/28f496554cb2421e86bb7bf2a597b7ae/users/46e0d9053f8441edab8e203f94ada59b/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.273906 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:23.289304 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f496554cb2421e86bb7bf2a597b7ae, user_id=46e0d9053f8441edab8e203f94ada59b, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.292018 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.305831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1457/2862] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:04:23 2022] PUT /identity/v3/projects/28f496554cb2421e86bb7bf2a597b7ae/users/46e0d9053f8441edab8e203f94ada59b/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:23.311885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed236e-c48d-4b9e-b093-a60433262244 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.312247 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed236e-c48d-4b9e-b093-a60433262244 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.312583 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed236e-c48d-4b9e-b093-a60433262244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.330891 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-4eed236e-c48d-4b9e-b093-a60433262244 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:23.332149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4eed236e-c48d-4b9e-b093-a60433262244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:23.392569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1406/2863] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:23.402097 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:23.403827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:23.460352 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6312e-8ee3-4c4a-ad28-d2793caa53b1 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:23.464165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:23.464871 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:23.465158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:23.465437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:23.476300 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:23.477781 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:23.492116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1458/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:27.540541 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:27.541054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:27.541142 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:27.570416 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] MFA Rules not processed for user `46e0d9053f8441edab8e203f94ada59b`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:27.571684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:27.615703 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:27.655087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1407/2865] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:27.659648 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:27.670299 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7c899-851d-4bb1-af46-adcc61949aa2 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:27.675215 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:27.675929 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:27.676217 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:27.677027 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] PATH_INFO: `/v3/projects` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:27.677754 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:27.679702 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:27.711568 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1459/2866] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:04:27.711908 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:27.726226 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69d5fc-ee15-417c-a4c4-b91330e5f755 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:27.792725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:27.793497 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:27.793792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:27.794376 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] PATH_INFO: `/v3/users` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:27.795128 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:27.797715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:27.821347 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1408/2867] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:04:27 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:04:27.826326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:27.836950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35c4b-0954-471e-840b-bc8fa1251724 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:27.842194 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:27.842784 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:27.843073 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:27.843353 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:27.844163 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:27.845869 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:27.858314 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1460/2868] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:27.862606 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:27.874526 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e6c7d-31c5-48af-a2c2-02a6386f2965 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:27.879938 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:27.880959 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:27.881250 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:27.881442 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] PATH_INFO: `/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c/users/cdc41157660f43259a145904041dfe41/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:27.898738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d241f7eafd47ca8b13a849f7ef2b2c, user_id=cdc41157660f43259a145904041dfe41, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:27.901666 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:27.925993 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1409/2869] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:04:27 2022] PUT /identity/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c/users/cdc41157660f43259a145904041dfe41/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:27.930257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:27.941640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4454a0b-a760-4a64-89cd-8c2a1ab8b506 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:28.012901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:28.013667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:28.013964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:28.014238 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:28.015189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:28.016876 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f75e1c-1cb5-4f31-bc94-b8782c91a6d7 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:28.028964 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1461/2870] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:04:28.032893 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:28.043747 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013116-8be3-4cc5-aeaf-155244028f46 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:28.049133 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:28.050520 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:28.050807 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:28.051253 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] PATH_INFO: `/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c/users/cdc41157660f43259a145904041dfe41/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:28.054045 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d241f7eafd47ca8b13a849f7ef2b2c, user_id=cdc41157660f43259a145904041dfe41, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:28.056792 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:28.068404 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1410/2871] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:04:28 2022] PUT /identity/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c/users/cdc41157660f43259a145904041dfe41/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:04:32.768838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d730-24aa-4cd8-9a8a-09ebe108b764 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:32.769289 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d730-24aa-4cd8-9a8a-09ebe108b764 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:32.769391 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d730-24aa-4cd8-9a8a-09ebe108b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:32.805392 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-16e2d730-24aa-4cd8-9a8a-09ebe108b764 None None] MFA Rules not processed for user `cdc41157660f43259a145904041dfe41`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:32.807552 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-16e2d730-24aa-4cd8-9a8a-09ebe108b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:32.863667 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:32.898920 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1462/2872] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:32.913706 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:32.915438 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:33.004640 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bc210-b6ab-4e52-99a7-60d254300153 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:33.008709 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:33.009370 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:33.009655 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:33.009934 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:33.032914 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:33.073004 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:33.074471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:33.085266 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1411/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:33.186960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddeb14-3565-4235-a074-1aa77d844207 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:33.187423 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddeb14-3565-4235-a074-1aa77d844207 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:33.187574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddeb14-3565-4235-a074-1aa77d844207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:33.240753 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-a1ddeb14-3565-4235-a074-1aa77d844207 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:33.242156 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a1ddeb14-3565-4235-a074-1aa77d844207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:33.313894 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1463/2874] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:04:33.362059 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:33.363853 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:33.457381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f761ee-7c4c-44db-b0a9-bfe02224f5b0 service glance] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:33.463085 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:33.463769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:33.464060 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:33.464342 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:33.472629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:33.474775 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:33.483230 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1412/2875] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 15:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:04:41.942839 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:41.943400 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:41.943540 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:41.968177 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] MFA Rules not processed for user `46e0d9053f8441edab8e203f94ada59b`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:41.969831 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:41.979953 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1464/2876] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:04:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:42.021715 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:42.031143 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f1e8-328e-463b-a9fb-cfcc442206f3 service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:42.034751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7a82e40184ae28526ca41ddca25d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:42.035375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:42.035770 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:42.036052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:42.037839 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:42.114755 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:42.116274 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:42.127652 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1413/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:42.358347 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:42.415726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c12be-7982-4263-aa55-4d022624b4c9 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:42.420815 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:42.421743 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:42.422126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:42.422513 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:42.424900 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:42.437852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:42.439305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a579ab-6764-4e8a-846c-99ba8c3846b1 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:42.448116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1465/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:42.805735 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:42.807135 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:42.818608 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599030c-2cfe-48c1-8536-1a7ce855f97b service glance] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:42.822245 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:42.822932 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:42.823186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:42.823624 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:42.825415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:42.840581 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:42.841669 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:42.854118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1414/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:04:43.978455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:43.979006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:43.979006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:43.999342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:04:44.000600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:44.009120 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1466/2880] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Jul 20 15:04:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:04:44.021191 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:44.028587 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=100 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:44.033498 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307fc06-ea6a-49f8-9567-c88318a042f5 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:44.039423 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:44.040118 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:44.040405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:44.040689 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:44.049593 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:44.051265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:44.060136 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1415/2881] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 15:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:04:53.992501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=84 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:54.057021 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=4 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:04:54.058141 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:04:54.072066 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81b835-8452-496c-8b7b-a2ca20518622 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:04:54.076152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:04:54.076843 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:04:54.077116 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:04:54.077390 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:04:54.079210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:04:54.089336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:04:54.090799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:04:54.099418 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1467/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:04:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:05:04.095174 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=6 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:05:08.029151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:05:08.039209 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8474e2b-9f01-47fc-ba3a-cff79953ea3b service swift] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:05:08.042883 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:05:08.043534 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:05:08.043825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:05:08.044110 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:05:08.053138 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:05:08.054626 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:05:08.064731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1416/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:05:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:05:18.060244 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:28.112811 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:28.114259 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:28.226616 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbc6-e8a5-4acb-95fd-f78a3612eb1e service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:28.238010 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:28.238739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:28.239036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:28.239317 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:28.241225 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:28.256008 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:28.257960 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:28.276646 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1468/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:34.409777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:34.462825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef07d1-20ec-4c09-8159-a58330a416fa service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:34.469357 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:34.470018 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:34.470310 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:34.470590 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:34.472443 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:34.486864 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:34.488516 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea8702-662a-4562-8f2e-2026c4adb86e service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:34.502105 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1417/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:34.541042 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:34.542565 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:34.633443 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdf0a-d91e-4d40-af81-3740277bf9ed service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:34.638625 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:34.639273 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:34.639590 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:34.639873 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:34.641695 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:34.654402 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:34.656032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:34.667772 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1469/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:35.464505 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:35.464907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:35.465206 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:35.496720 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] MFA Rules not processed for user `b698cb9f41704c67aeb2c667b7a7324e`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:35.497921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:35.505326 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1418/2887] 10.222.0.23 () {58 vars in 967 bytes} [Wed Jul 20 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:35.549802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:35.562158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19b377-3468-4257-a86f-94ab9ff89f52 service placement] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:35.567197 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52d17454c264a51a14b1d6a7786b570', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:35.567913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:35.568210 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:35.568574 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:35.577877 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:35.579543 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:35.587562 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1470/2888] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Jul 20 15:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:07:39.118029 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:39.139375 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b750d3-8581-44c6-b6a9-cbb04138b228 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:39.148086 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:39.149290 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:39.150297 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:39.150769 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:39.153356 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:39.173228 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:39.174940 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:39.191441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1419/2889] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:42.558052 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:42.632733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=100 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:42.668677 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769cb3-be6d-4343-8cf9-1ea986f8ba70 service swift] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:42.677178 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:42.678675 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:42.679181 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:42.679729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] PATH_INFO: `/v3/users/46e0d9053f8441edab8e203f94ada59b` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:42.682629 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e0d9053f8441edab8e203f94ada59b)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:42.687248 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:42.743909 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e0d9053f8441edab8e203f94ada59b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:42.752901 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e0d9053f8441edab8e203f94ada59b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:42.766484 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e0d9053f8441edab8e203f94ada59b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:42.774200 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e0d9053f8441edab8e203f94ada59b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:42.775176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e0d9053f8441edab8e203f94ada59b'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:42.782485 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1471/2890] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:07:42 2022] DELETE /identity/v3/users/46e0d9053f8441edab8e203f94ada59b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:42.963125 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:42.979381 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5375-a5db-4d56-ab6d-855596c52d62 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.041405 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.042283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.042569 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.042849 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] PATH_INFO: `/v3/projects/28f496554cb2421e86bb7bf2a597b7ae` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.044068 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f496554cb2421e86bb7bf2a597b7ae)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:43.045976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:43.093053 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f496554cb2421e86bb7bf2a597b7ae', 'request_id': 'req-85728908-f195-4e29-bc8f-a68a298033a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.100368 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f496554cb2421e86bb7bf2a597b7ae', 'request_id': 'req-85728908-f195-4e29-bc8f-a68a298033a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.106681 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f496554cb2421e86bb7bf2a597b7ae', 'request_id': 'req-85728908-f195-4e29-bc8f-a68a298033a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.133123 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] The token cache is being invalidate because project 28f496554cb2421e86bb7bf2a597b7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:07:43.133455 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.134109 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.135724 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1420/2891] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:07:42 2022] DELETE /identity/v3/projects/28f496554cb2421e86bb7bf2a597b7ae => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:43.139729 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:43.141165 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:43.155594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1488-99be-4af7-88ee-dad80a553101 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.212724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.213609 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.213891 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.214167 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] PATH_INFO: `/v3/users/cdc41157660f43259a145904041dfe41` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.215378 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc41157660f43259a145904041dfe41)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:43.217336 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:43.265913 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc41157660f43259a145904041dfe41'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.269491 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:43.273640 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc41157660f43259a145904041dfe41'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.288415 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc41157660f43259a145904041dfe41'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.295232 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc41157660f43259a145904041dfe41'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.295908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-f04c3a5f-5235-419f-b77f-22fe0894922f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc41157660f43259a145904041dfe41'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.301737 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1472/2892] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:07:43 2022] DELETE /identity/v3/users/cdc41157660f43259a145904041dfe41 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:43.478561 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:43.480070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:43.493183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85728908-f195-4e29-bc8f-a68a298033a6 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.497151 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:43.559800 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.560672 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.560958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.561238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] PATH_INFO: `/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.562441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d241f7eafd47ca8b13a849f7ef2b2c)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:43.564410 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:43.611213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d241f7eafd47ca8b13a849f7ef2b2c', 'request_id': 'req-1811ed9a-899f-4c82-9730-cfb61e763d57'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.619137 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d241f7eafd47ca8b13a849f7ef2b2c', 'request_id': 'req-1811ed9a-899f-4c82-9730-cfb61e763d57'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.624868 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d241f7eafd47ca8b13a849f7ef2b2c', 'request_id': 'req-1811ed9a-899f-4c82-9730-cfb61e763d57'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.636836 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] The token cache is being invalidate because project 68d241f7eafd47ca8b13a849f7ef2b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:07:43.637132 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.637794 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-1811ed9a-899f-4c82-9730-cfb61e763d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:07:43.639348 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1421/2893] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:07:43 2022] DELETE /identity/v3/projects/68d241f7eafd47ca8b13a849f7ef2b2c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:07:43.644466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.644955 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.645060 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.704591 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:43.706245 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:43.774477 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1473/2894] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:43.783052 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.783372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.783966 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.803950 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:43.805181 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:43.813805 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1422/2895] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:43.818316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:43.829460 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1cacb-fb9b-4411-928d-403a34ed20e3 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.834455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.835150 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.835490 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.835809 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] PATH_INFO: `/v3/domains` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.837069 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92083) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:07:43.837387 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:43.839065 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:43.852519 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1474/2896] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Jul 20 15:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:07:43.857474 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:43.867746 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b5798-9ad0-43b1-90bb-e598097769da None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.873036 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.873721 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.874007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.874292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.875026 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:43.877007 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:43.908621 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1423/2897] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:07:43 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:07:43.915266 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:43.925952 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7916ef-d241-4ff5-9379-c4a1d987688a admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:43.997744 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:43.998419 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:43.998703 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:43.998978 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:43.999706 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:44.001631 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:44.022679 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1475/2898] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:07:43 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:07:44.026899 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:44.037379 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af768506-c006-443f-88f5-342dd3e676a2 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:44.042514 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:44.043194 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:44.043489 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:44.043771 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:44.044502 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:44.046096 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:44.057186 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1424/2899] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:07:44.061282 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:44.071294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364dad-0ac7-4d26-acf8-be5353fd9751 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:44.075973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:44.076653 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:44.076932 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:44.077204 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:44.077925 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:44.079547 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e427f-05b2-4948-b04e-fbd3ffc1fa72 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:44.091435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1476/2900] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:07:44.095651 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:44.106468 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7635-e5ab-4f21-881d-2c65a76f1288 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:44.111629 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:44.112519 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] REQUEST_METHOD: `PUT` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:44.112809 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:44.113100 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] PATH_INFO: `/v3/projects/f4e3faccd7f943bb93643488053fa3a5/users/8cc83cabf06a428b8f8d19c4f9f2b17f/roles/c0d3425b913b4de780118a257ec996d2` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:44.128533 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e3faccd7f943bb93643488053fa3a5, user_id=8cc83cabf06a428b8f8d19c4f9f2b17f, role_id=c0d3425b913b4de780118a257ec996d2)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:44.131171 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:44.145043 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1425/2901] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:07:44 2022] PUT /identity/v3/projects/f4e3faccd7f943bb93643488053fa3a5/users/8cc83cabf06a428b8f8d19c4f9f2b17f/roles/c0d3425b913b4de780118a257ec996d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:44.150212 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c179-62df-457a-ba66-36fbc3a6b603 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:44.150501 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c179-62df-457a-ba66-36fbc3a6b603 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:44.150780 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c179-62df-457a-ba66-36fbc3a6b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:44.157516 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:44.170189 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-cb58c179-62df-457a-ba66-36fbc3a6b603 None None] MFA Rules not processed for user `dca8d47aa90c480bb8c128187af71164`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:44.171409 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-cb58c179-62df-457a-ba66-36fbc3a6b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:44.233973 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1477/2902] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:44.244398 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:44.246078 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:44.283374 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:44.325334 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003de9d-4289-4452-a80b-34ff7fccf417 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:44.329082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:44.329731 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:44.330015 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:44.330299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:44.339937 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:44.341372 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:44.350782 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1426/2903] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:48.569647 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:48.570242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:48.570242 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:48.601126 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.auth.core [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] MFA Rules not processed for user `8cc83cabf06a428b8f8d19c4f9f2b17f`. Rule list: `[]` (Enabled: `True`). {{(pid=92083) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:48.602995 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:48.715435 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1478/2904] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:48.720189 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:48.731734 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e2fe2-af28-425f-ac24-33bcb3653ad8 service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:48.736925 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:48.737600 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:48.737885 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:48.738163 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:48.738879 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:48.740841 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:48.772840 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1427/2905] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Jul 20 15:07:48 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:07:48.777723 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:48.790687 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03a1dd-3563-41cf-bb3b-6845931a4a95 None None] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:48.859354 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:48.859988 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] REQUEST_METHOD: `POST` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:48.860272 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:48.860549 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] PATH_INFO: `/v3/users` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:48.861260 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:48.863234 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:48.885779 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1479/2906] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Jul 20 15:07:48 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:07:48.890116 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:48.907495 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16df0-81a7-4b77-b9c1-a6176c38cbc0 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:48.912559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:48.913265 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:48.913556 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:48.913847 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:48.914618 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:48.916964 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:48.928967 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1428/2907] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:07:48.933002 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:48.944444 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde070e-5b60-4b7d-bb00-0b3b3fd7b964 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:48.949689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:48.950660 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:48.950963 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:48.951257 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] PATH_INFO: `/v3/projects/1505fd2d5d284979b656b316c67da5fa/users/9f08461af53a45178e089d26fdba2782/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:48.970028 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1505fd2d5d284979b656b316c67da5fa, user_id=9f08461af53a45178e089d26fdba2782, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:48.972739 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:48.984358 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:48.989977 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1480/2908] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:07:48 2022] PUT /identity/v3/projects/1505fd2d5d284979b656b316c67da5fa/users/9f08461af53a45178e089d26fdba2782/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:48.994555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:49.005871 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103381d6-825f-444a-9578-8f159cedea57 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:49.070281 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:49.071087 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:49.071312 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:49.071634 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:49.072382 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:49.074926 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68067f-b971-4bf2-a922-b13d54898ff8 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:49.085797 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1429/2909] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Jul 20 15:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:07:49.090986 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:49.101747 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e1a9-733f-470c-8f1f-c59ac58addfd admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:49.107389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:49.108223 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] REQUEST_METHOD: `PUT` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:49.108522 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:49.108799 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] PATH_INFO: `/v3/projects/1505fd2d5d284979b656b316c67da5fa/users/9f08461af53a45178e089d26fdba2782/roles/feb024fd5f1a4880bb9594368aa0345c` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:49.110790 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1505fd2d5d284979b656b316c67da5fa, user_id=9f08461af53a45178e089d26fdba2782, role_id=feb024fd5f1a4880bb9594368aa0345c)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:49.113466 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:49.124645 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1481/2910] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Jul 20 15:07:49 2022] PUT /identity/v3/projects/1505fd2d5d284979b656b316c67da5fa/users/9f08461af53a45178e089d26fdba2782/roles/feb024fd5f1a4880bb9594368aa0345c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:07:54.358777 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd5fb-8ef9-4833-98f0-1a743f707a9b None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:54.359294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd5fb-8ef9-4833-98f0-1a743f707a9b None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:54.359294 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd5fb-8ef9-4833-98f0-1a743f707a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:54.398496 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-422fd5fb-8ef9-4833-98f0-1a743f707a9b None None] MFA Rules not processed for user `9f08461af53a45178e089d26fdba2782`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:54.400412 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-422fd5fb-8ef9-4833-98f0-1a743f707a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:54.483204 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1430/2911] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:07:54.500316 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:07:54.503199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:54.608727 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c3c4-563e-4983-a690-fb6c7477ff11 admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:07:54.616600 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:07:54.617274 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:54.618476 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:54.618949 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:54.705933 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:07:54.707807 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:07:54.718105 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1482/2912] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:07:55.777714 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] REQUEST_METHOD: `POST` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:07:55.778237 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:07:55.778359 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:07:55.786768 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:07:55.798596 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.auth.core [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] MFA Rules not processed for user `8cc83cabf06a428b8f8d19c4f9f2b17f`. Rule list: `[]` (Enabled: `True`). {{(pid=92084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:07:55.799860 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:07:55.807725 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1431/2913] 10.222.0.23 () {58 vars in 957 bytes} [Wed Jul 20 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:08:04.713294 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:08:05.796054 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:08:12.396722 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:08:12.456455 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c326c-bc8d-4a26-ab22-862c510256f5 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:08:12.460085 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:08:12.460724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:08:12.461006 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:08:12.461281 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:08:12.463051 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:08:12.473701 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:08:12.475537 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:08:12.484796 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1483/2914] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:08:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:08:12.940112 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:08:12.941751 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:08:13.015673 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7008-868d-4a5b-afe4-c10466ca3240 None None] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:08:13.020704 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:08:13.021354 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:08:13.021642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:08:13.021922 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:08:13.023748 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:08:13.035260 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:08:13.036892 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:08:13.047234 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1432/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:08:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:08:21.267267 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:08:21.269173 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:08:21.311860 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2568-ff7f-4fde-99e4-d3cbd16640ae service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:08:21.318152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:08:21.318804 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:08:21.319088 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:08:21.319362 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:08:21.321624 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:08:21.336063 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:08:21.337676 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:08:21.349305 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1484/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:08:23.044757 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=32 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:08:23.686407 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:08:23.695944 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474680-ea15-4269-ae6c-42769a6e8865 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:08:23.700292 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:08:23.700933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:08:23.701251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:08:23.701535 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:08:23.710740 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:08:23.712201 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:08:23.723430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1433/2917] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:08:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:08:31.344634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=41 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:08:33.718182 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:45.983828 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:45.993855 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd1f2-9d51-4d99-8c07-3374a25a3b90 service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:45.997670 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:45.998325 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:45.998623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:45.998904 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.000806 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:46.014852 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.016363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.026763 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1485/2918] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:10:49.257366 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:49.266299 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a2f4-c5c0-4f01-ab10-d4a9575ba70e service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:49.270559 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:49.271221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:49.271545 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:49.271830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:49.273613 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:49.288562 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:49.289990 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:49.301183 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1434/2919] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:10:50.481776 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:50.483176 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:50.494389 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c053-a934-4441-9b49-96939a86f431 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:50.498133 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:50.498766 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:50.499049 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:50.499326 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:50.501149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:50.514907 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:50.516436 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:50.528363 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1486/2920] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:10:59.296221 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.523036 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=12 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:02.531911 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.540830 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63dcd-cd98-40a7-a59a-798ff5f44aed service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:02.544684 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:02.545341 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.545632 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.545921 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.547958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:02.561083 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:02.562350 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:02.572238 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1435/2921] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:11:02.700346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.709791 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a30e-a245-4f7b-bf3a-40bf44c5ee75 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:02.713581 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:02.714229 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.714520 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.714802 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.716634 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:02.730510 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:02.732280 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:02.744755 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1487/2922] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:11:12.567798 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=6 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.739658 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=6 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.263609 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.265106 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:41.279834 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaee906-ad57-4611-bb19-57668781f1fd service neutron] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.285415 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.286242 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.286436 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.286766 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.288907 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:41.301738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.303321 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.313488 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1436/2923] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:12:44.427623 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:44.439841 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae97eb3-dabc-494e-b8c7-56eb919e1620 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:44.446199 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:44.446922 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:44.447288 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:44.447596 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:44.449346 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:44.463724 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:44.465333 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:44.477838 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1488/2924] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:12:46.774301 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:46.789057 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bb075-ea8e-425b-acb8-be9cb0fc315e service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:46.794894 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54774acef6c54a06a81facfe13173568', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.795642 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.795975 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.796258 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.798875 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:46.813028 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.814470 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.826283 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1437/2925] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:12:48.276950 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:48.299524 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58896d44-a20d-48ba-a17a-6b1d7f3520de service nova] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:48.303756 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64bc77e79518405f8915783e7fee812b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:48.304437 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.304726 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.305009 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.377115 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:48.379132 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:48.389093 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1489/2926] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:12:51.985958 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.998251 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309b25-2f49-4220-aa3c-b557828ee71d service nova] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:52.007051 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:52.008102 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] REQUEST_METHOD: `GET` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.008555 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.008976 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.012187 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:52.029395 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:52.031825 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:52.050987 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1438/2927] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:12:55.109068 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:55.127413 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce9c6b-34ba-4a4c-8e4f-3225b98c8636 service neutron] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:55.135689 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:55.136602 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.136886 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.137171 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] PATH_INFO: `/v3/users/8cc83cabf06a428b8f8d19c4f9f2b17f` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.141193 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc83cabf06a428b8f8d19c4f9f2b17f)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:55.144373 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:55.229741 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc83cabf06a428b8f8d19c4f9f2b17f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.240541 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc83cabf06a428b8f8d19c4f9f2b17f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.256448 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc83cabf06a428b8f8d19c4f9f2b17f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.265159 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc83cabf06a428b8f8d19c4f9f2b17f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.265404 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc83cabf06a428b8f8d19c4f9f2b17f'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.274149 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1490/2928] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:12:55 2022] DELETE /identity/v3/users/8cc83cabf06a428b8f8d19c4f9f2b17f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:55.511180 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:55.523572 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9aa7-1cfa-4a9c-8e22-94d7a4371665 service placement] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:55.598441 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:55.599149 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.599430 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.599738 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] PATH_INFO: `/v3/projects/f4e3faccd7f943bb93643488053fa3a5` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.600980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e3faccd7f943bb93643488053fa3a5)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:55.602880 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:55.664858 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e3faccd7f943bb93643488053fa3a5', 'request_id': 'req-68626ca2-a5d7-4bfb-8475-7ab493315086'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.673671 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e3faccd7f943bb93643488053fa3a5', 'request_id': 'req-68626ca2-a5d7-4bfb-8475-7ab493315086'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.680313 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e3faccd7f943bb93643488053fa3a5', 'request_id': 'req-68626ca2-a5d7-4bfb-8475-7ab493315086'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.692530 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] The token cache is being invalidate because project f4e3faccd7f943bb93643488053fa3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:12:55.692850 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.693529 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.695090 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1439/2929] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:12:55 2022] DELETE /identity/v3/projects/f4e3faccd7f943bb93643488053fa3a5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:55.699158 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:55.701152 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:55.715241 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86938eb-98c0-42f8-98e7-8a3627c961de admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:55.766468 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:55.779935 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:55.781101 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.781553 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.782032 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] PATH_INFO: `/v3/users/9f08461af53a45178e089d26fdba2782` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.783301 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f08461af53a45178e089d26fdba2782)` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:55.785827 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:55.842892 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f08461af53a45178e089d26fdba2782'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.852342 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f08461af53a45178e089d26fdba2782'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.865440 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f08461af53a45178e089d26fdba2782'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.873258 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f08461af53a45178e089d26fdba2782'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.873987 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.notifications [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f08461af53a45178e089d26fdba2782'} {{(pid=92083) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:55.880040 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1491/2930] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Jul 20 15:12:55 2022] DELETE /identity/v3/users/9f08461af53a45178e089d26fdba2782 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:56.085070 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Authenticating user token {{(pid=92084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:56.086969 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.fernet_utils [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:56.103284 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68626ca2-a5d7-4bfb-8475-7ab493315086 admin admin] Validating token access rules against request {{(pid=92084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:56.159082 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:56.174049 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca8d47aa90c480bb8c128187af71164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d2c10ce8e0d4f8ab9d78c156b64a59e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:56.175115 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.175476 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.175863 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] PATH_INFO: `/v3/projects/1505fd2d5d284979b656b316c67da5fa` {{(pid=92084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.177202 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1505fd2d5d284979b656b316c67da5fa)` {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:56.179345 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] RBAC: Authorization granted {{(pid=92084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:56.234980 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1505fd2d5d284979b656b316c67da5fa', 'request_id': 'req-98de9518-e1e5-4691-968f-d265356fe5a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:56.244622 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1505fd2d5d284979b656b316c67da5fa', 'request_id': 'req-98de9518-e1e5-4691-968f-d265356fe5a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:56.252210 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1505fd2d5d284979b656b316c67da5fa', 'request_id': 'req-98de9518-e1e5-4691-968f-d265356fe5a6'} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:56.265176 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] The token cache is being invalidate because project 1505fd2d5d284979b656b316c67da5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:12:56.265471 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:56.266213 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG keystone.notifications [None req-98de9518-e1e5-4691-968f-d265356fe5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:12:56.267765 dv-cinder-849022-4-smb devstack@keystone.service[92084]: [pid: 92084|app: 0|req: 1440/2931] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Jul 20 15:12:56 2022] DELETE /identity/v3/projects/1505fd2d5d284979b656b316c67da5fa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:13:05.876438 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:06.261933 dv-cinder-849022-4-smb devstack@keystone.service[92084]: DEBUG dbcounter [-] [92084] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:48.266545 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Authenticating user token {{(pid=92083) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:48.268557 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:48.454908 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121645-60fd-4d26-bf3c-a504e6e5db7d admin admin] Validating token access rules against request {{(pid=92083) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:48.524733 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90ce225267684e4b89e38e76fe317aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd132cd5b9542485a9994e9251b10873b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92083) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:48.525318 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] REQUEST_METHOD: `GET` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:48.525594 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] SCRIPT_NAME: `/identity` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:48.525868 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92083) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:48.527794 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.fernet_utils [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92083) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:48.540617 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:48.542250 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c50db-1efe-4244-b778-86321e2bf556 service placement] RBAC: Authorization granted {{(pid=92083) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:48.553502 dv-cinder-849022-4-smb devstack@keystone.service[92083]: [pid: 92083|app: 0|req: 1492/2932] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Jul 20 15:17:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:17:58.548307 dv-cinder-849022-4-smb devstack@keystone.service[92083]: DEBUG dbcounter [-] [92083] Writing DB stats keystone:SELECT=89 {{(pid=92083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}